WP30: E4 chains (7,200 trials) and E5 fan-in (1,600) complete, results sections for handoffs/fan-in/hosted/network/frontier/router, figure fixes
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
57 changed files +8,088 −298
modified
Makefile
+4 −1
@@ -1,6 +1,9 @@ | |||||
| 1 | .PHONY: paper reproduce-analysis test clean-paper | 1 | .PHONY: paper reproduce-analysis test clean-paper | ||
| 2 | PY=.venv/bin/python | 2 | PY=.venv/bin/python | ||
| 3 | −paper: | 3 | +paper: figures-sync | ||
| 4 | +figures-sync: | ||||
| 5 | + cp results/figures/*.pdf paper/figures/ 2>/dev/null || true | ||||
| 6 | + | ||||
| 4 | cd paper && latexmk -pdf -interaction=nonstopmode -halt-on-error main.tex >/dev/null && cp main.pdf WP30_Boucher_Cache_Compression_Knowledge_Transfer.pdf && echo "paper/WP30_Boucher_Cache_Compression_Knowledge_Transfer.pdf" | 7 | cd paper && latexmk -pdf -interaction=nonstopmode -halt-on-error main.tex >/dev/null && cp main.pdf WP30_Boucher_Cache_Compression_Knowledge_Transfer.pdf && echo "paper/WP30_Boucher_Cache_Compression_Knowledge_Transfer.pdf" | ||
| 5 | reproduce-analysis: | 8 | reproduce-analysis: | ||
| 6 | $(PY) -m wp30 analyze --protocol protocol/frozen.json && $(PY) -m wp30.analysis.static_tables && $(PY) -m wp30 audit-artifacts --root . | 9 | $(PY) -m wp30 analyze --protocol protocol/frozen.json && $(PY) -m wp30.analysis.static_tables && $(PY) -m wp30 audit-artifacts --root . | ||
added
paper/figures/fig2_quality_vs_bytes.pdf
+0 −0
Binary file not shown.
added
paper/figures/fig3_quality_vs_latency_memory.pdf
+0 −0
Binary file not shown.
added
paper/figures/fig4_latency_decomposition.pdf
+0 −0
Binary file not shown.
added
paper/figures/fig5_handoffs.pdf
+0 −0
Binary file not shown.
added
paper/figures/fig6_breakeven.pdf
+0 −0
Binary file not shown.
added
paper/figures/fig7_router.pdf
+0 −0
Binary file not shown.
added
paper/figures/figA_quality_vs_bytes_aware.pdf
+0 −0
Binary file not shown.
added
paper/figures/figA_quality_vs_bytes_blind.pdf
+0 −0
Binary file not shown.
modified
paper/main.pdf
+0 −0
Binary file not shown.
modified
paper/sections/results_fanin.tex
+33 −1
@@ -1 +1,33 @@ | |||||
| 1 | −% pending | 1 | +\subsection{Fan-in, composition and conflicting evidence (E5)} | ||
| 2 | +\label{sec:fanin} | ||||
| 3 | +Each of 20 synthetic test documents was partitioned among $k\in\{2,4\}$ source agents (project blocks round-robin), one source received an | ||||
| 4 | +additional \emph{superseded} revision sentence for a project also held by another source (a conflict that the ledger's date-precedence rule | ||||
| 5 | +resolves), and the last source received an irrelevant block from another document. An aggregator (Qwen2.5-3B) answered the multi-hop, | ||||
| 6 | +aggregation, revision, temporal and unanswerable questions (8 per document; 1\,600 trials, no failures) from one of five compositions | ||||
| 7 | +(Table~\ref{tab:fanin}): the concatenated source texts (reference), concatenated 512-token summaries, merged structured records with the | ||||
| 8 | +precedence rule stated, a shared-memory index with metered retrieval (at most three lookups and 1\,500 bytes per source), and a | ||||
| 9 | +\emph{negative control} that concatenates the KV caches of the independently prefilled sources along the position axis---an operation that | ||||
| 10 | +is not valid by construction (overlapping positions, no cross-source context during prefill) and is reported only as a diagnostic. | ||||
| 11 | + | ||||
| 12 | +\begin{table}[t]\centering\scriptsize | ||||
| 13 | +\caption{Fan-in accuracy (\%, 95\,\% cluster-bootstrap CI) by composition method and question type; $k$ = number of source agents. Twenty | ||||
| 14 | +documents; multi-hop and revision 40 trials per cell, aggregation and temporal 20, unanswerable 40.}\label{tab:fanin} | ||||
| 15 | +\adjustbox{max width=\textwidth}{\input{tables/table_fanin}} | ||||
| 16 | +\end{table} | ||||
| 17 | + | ||||
| 18 | +\paragraph{Prose composes; structured records and references do not, at this budget.} Concatenated summaries match the full-context reference | ||||
| 19 | +on multi-hop joins (92 vs 95--98\,\%) and on the conflicting revisions (65--70 vs 60--62\,\%: the summaries carry the dates, and the aggregator | ||||
| 20 | +applies the precedence rule as well from summaries as from the sources). Merged structured records fall to 22--32\,\% on multi-hop and | ||||
| 21 | +15--45\,\% on revisions, again because each 512-token extraction covers only part of its source, and a join needs both parts. Shared memory with | ||||
| 22 | +metered retrieval improves with more sources (38 $\to$ 60\,\% multi-hop, 45 $\to$ 68\,\% revision from $k=2$ to $k=4$) because more references | ||||
| 23 | +exist to be fetched, at 1.4--3.3~kB of fetched source per question on top of a 3--6~kB index. Every method abstained correctly on the | ||||
| 24 | +unanswerable questions (98--100\,\%), including those about the irrelevant block's projects, and no method---not even the full-context | ||||
| 25 | +reference---solved the numerical aggregation (0\,\% everywhere): summing five to six seven-digit amounts is beyond the 3B aggregator regardless | ||||
| 26 | +of representation, a receiver limit rather than a communication effect. | ||||
| 27 | + | ||||
| 28 | +\paragraph{The cache-concatenation control is not zero, and that is the warning.} Feeding the aggregator two independently built caches laid | ||||
| 29 | +end to end gave 70\,\% on multi-hop and 50\,\% on revisions at $k=2$, falling to 52 and 25\,\% at $k=4$ (Table~\ref{tab:fanin}). Attention can | ||||
| 30 | +still find a fact whose key happens to be reachable, so a shape-compatible but semantically invalid composition produces plausible answers | ||||
| 31 | +instead of failing loudly; this is exactly the failure mode that compatibility manifests must prevent, and it is why we report the control | ||||
| 32 | +as a diagnostic and not as a method. A valid cache composition would need either re-encoding with consistent positions (i.e., a fresh prefill) | ||||
| 33 | +or a composition-aware method, none of which was available for these models. | ||||
modified
paper/sections/results_frontier.tex
+103 −1
@@ -1 +1,103 @@ | |||||
| 1 | −% pending | 1 | +\subsection{Single-handoff compression frontier (E1)} | ||
| 2 | +\label{sec:results-frontier} | ||||
| 3 | +Table~\ref{tab:primary} and Figure~\ref{fig:frontier} summarize the core campaign: 160 test documents, 22 conditions, two model pairs, | ||||
| 4 | +13\,280 scheduled trials, all executed; 74 attempts ended as \emph{invalid output} (empty or non-text generations, all from 4-bit Qwen caches and | ||||
| 5 | +random eviction) and 240 as \emph{implementation error} (LLMLingua-2 on the Llama pair: the cluster node lacked the PyTorch runtime; those | ||||
| 6 | +trials were retried on the laptop and both attempts are kept, Appendix~\ref{app:tables}). Failures count as zero quality. | ||||
| 7 | + | ||||
| 8 | +\begin{figure}[p]\centering\includegraphics[width=\textwidth]{fig2_quality_vs_bytes.pdf} | ||||
| 9 | +\caption{Quality against measured serialized payload bytes (log scale), by task family (columns) and model pair (rows). Each point is one | ||||
| 10 | +condition (median payload, mean quality, 95\,\% cluster-bootstrap CI). Text methods cluster at $10^2$--$10^4$ bytes, cache methods at | ||||
| 11 | +$10^7$--$10^9$ bytes: a 3B-parameter cache of a document is three to four orders of magnitude larger than the document. Question-aware and | ||||
| 12 | +question-blind conditions are both shown here; Appendix figures separate them.}\label{fig:frontier}\end{figure} | ||||
| 13 | + | ||||
| 14 | +\begin{table}[p]\centering\scriptsize | ||||
| 15 | +\caption{Primary comparison: quality (\%, with 95\,\% cluster-bootstrap CI) per condition, family and pair. Synthetic = private-fact accuracy | ||||
| 16 | +(5 questions per document: single fact, exact copy, multi-hop), exec = hidden-test pass (all 5 tests), QASPER/2Wiki = LongBench F1. | ||||
| 17 | +``blind''/``aware'' = question access of the compressor. Latency and bytes for the synthetic family in Table~\ref{tab:cost}.}\label{tab:primary} | ||||
| 18 | +\adjustbox{max width=\textwidth}{\input{tables/table_primary}} | ||||
| 19 | +\end{table} | ||||
| 20 | + | ||||
| 21 | +\paragraph{Lossless representations are interchangeable; nothing else is.} Full text (A1), zstd-compressed text (A7), the native cache | ||||
| 22 | +(B0), the serialized and reloaded cache (B1) and the 8-bit packed cache (B2-8) give the same answers within noise on every family and pair | ||||
| 23 | +(T2: B2-8 vs B0 \DiffTW{} points, Holm $p=\PTW$; T6: A1 vs B0 $p=\PTX$; $n=\NTW$ paired instances each). This is the expected | ||||
| 24 | +consistency result---the cache \emph{is} the document as the receiver read it---and it is also the only region of the frontier where | ||||
| 25 | +representation choice is free of quality cost. The A7 result confirms H8: the codec shrinks the text payload ${\approx}3.5\times$ | ||||
| 26 | +(\BSyntheticQwenAO{} bytes raw for an average synthetic document) with no effect on quality or receiver time, while on bf16 caches zstd saves | ||||
| 27 | +${\approx}20$\,\% (Section~\ref{sec:network}). | ||||
| 28 | + | ||||
| 29 | +\paragraph{Packed 4-bit quantization is model-dependent (H2 confirmed).} At 4 bits with 64-element groups, Llama-3.2-3B keeps | ||||
| 30 | +\QSyntheticLlamaBWBitsF{}\,\% accuracy on private facts and \QExecLlamaBWBitsF{}\,\% on executable tasks, whereas Qwen2.5-3B collapses to | ||||
| 31 | +\QSyntheticQwenBWBitsF{}\,\% and \QExecQwenBWBitsF{}\,\% (T3, both pairs pooled: \DiffTH{} points, Holm $p=\PTH$). The failure is total | ||||
| 32 | +(garbled tokens, 29 empty generations), it reproduces in the native \texttt{mlx-lm} path, and it is the per-token affine quantization of Qwen's | ||||
| 33 | +outlier key channels that KIVI's per-channel scheme was designed to avoid. Eight bits are safe for both models; halving the cache is therefore | ||||
| 34 | +free for both, quartering it is free for one. | ||||
| 35 | + | ||||
| 36 | +\paragraph{Eviction without the question is destructive; eviction with the question is nearly free---for retrieval, not for code.} Keeping a | ||||
| 37 | +quarter of the positions by the sink-plus-recent rule (B3) leaves \QSyntheticQwenBHK{}\,\% (Qwen) and \QSyntheticLlamaBHK{}\,\% (Llama) on | ||||
| 38 | +private facts, close to the share of facts that happen to sit in the retained window; random retention (B4) is at zero and produces | ||||
| 39 | +incoherent output on both models. The SnapKV-style rule with the question as observation window (B5-aware) recovers \QSyntheticQwenBVKAware{}\,\% | ||||
| 40 | +(Qwen) and \QSyntheticLlamaBVKAware{}\,\% (Llama) at the same 1/4 budget (T4 vs B3: \DiffTF{} points, Holm $p=\PTF$, H3 confirmed in its | ||||
| 41 | +first half), and the pyramid allocation (B6) and the selection-plus-8-bit composition (B9) behave like B5. With a generic window instead of | ||||
| 42 | +the question (B5-blind) the same algorithm falls to \QSyntheticQwenBVKBlind{}\,\%/\QSyntheticLlamaBVKBlind{}\,\%: attention-based selection | ||||
| 43 | +is a \emph{question-aware} method and must be compared as one (H7). On the executable family every eviction method, aware or not, scores | ||||
| 44 | +zero on both models: a code specification cannot be quartered, because every rule in the ticket matters for the hidden tests. On the public | ||||
| 45 | +QA subsets eviction costs little (the answers are short spans), but the F1 ceiling of 3B receivers is low (A1 $\approx$ 0.25--0.39). | ||||
| 46 | + | ||||
| 47 | +\paragraph{Text compression at a 512-token budget: summaries beat structured evidence, extraction beats both when the question is known.} | ||||
| 48 | +Question-blind summaries (A4) retain \QSyntheticQwenAFBBlind{}\,\% (Qwen) and \QSyntheticLlamaAFBBlind{}\,\% (Llama) of the private-fact | ||||
| 49 | +answers; structured JSON evidence with spans (A5) only \QSyntheticQwenAVBBlind{}\,\%/\QSyntheticLlamaAVBBlind{}\,\% (T1: \DiffTO{} points, | ||||
| 50 | +Holm $p=\PTO$, $n=\NTO$). H1's expectation that typed facts would protect identifiers and numbers is \emph{rejected} at this budget: the | ||||
| 51 | +sender spends its 512 output tokens on exact quotes (provenance) and emits ${\approx}8$ facts out of 62 per document, so most answers are | ||||
| 52 | +simply absent from the message; the receiver answers ``unknown'' (correctly abstaining) rather than hallucinating. References plus metered | ||||
| 53 | +retrieval (A6) repair little (\QSyntheticQwenAXBRBlind{}\,\%/\QSyntheticLlamaAXBRBlind{}\,\%) because the reference index inherits the same | ||||
| 54 | +coverage. Deterministic extraction (A3) is the strongest cheap method: blind centrality selection keeps \QSyntheticQwenAHBBlind{}\,\%, and with | ||||
| 55 | +the question (BM25) \QSyntheticQwenAHBAware{}\,\%/\QSyntheticLlamaAHBAware{}\,\%---indistinguishable from full text at 1/15 of the bytes. | ||||
| 56 | +Head/tail truncation (A2) keeps exactly the facts that fall in the kept windows (\QSyntheticQwenAWB{}\,\%). On the executable family the | ||||
| 57 | +ordering changes: blind extractive selection keeps the whole specification (\QExecQwenAHBBlind{}\,\%/\QExecLlamaAHBBlind{}\,\%) because the | ||||
| 58 | +rules are dense in digits and identifiers, and the Llama summary preserves the rules better than the Qwen summary | ||||
| 59 | +(\QExecLlamaAFBBlind{} vs \QExecQwenAFBBlind{}\,\%). LLMLingua-2 (A8) at the same rate removes the very tokens the questions ask for | ||||
| 60 | +(\QSyntheticQwenAEBBlind{}\,\% on private facts, 0 on code) while being competitive on QASPER (\QQasperQwenAEBBlind{} vs | ||||
| 61 | +\QQasperQwenAO{}\,\% F1 for full text): a compressor trained on meeting transcripts is tuned for paraphrasable content, not for exact values. | ||||
| 62 | + | ||||
| 63 | +\paragraph{Cost accounting changes the ranking (RQ3).} Table~\ref{tab:cost} gives, for the synthetic family, the median serialized bytes and | ||||
| 64 | +the cold and warm per-query latencies assembled from the recorded spans. In bytes, every text method beats every cache method by | ||||
| 65 | +$10^3$--$10^4$. In cold latency on the laptop (Qwen pair), full text costs \TcoldSyntheticQwenAO{}~ms per question (prefill of the whole | ||||
| 66 | +document each time), the native cache \TcoldSyntheticQwenBZ{}~ms (document prefill once plus the fresh question), and a blind summary | ||||
| 67 | +\TcoldSyntheticQwenAFBBlind{}~ms---the sender's generation dominates. In the warm, reused regime the ranking inverts: the cache answers a new | ||||
| 68 | +question in \TwarmSyntheticQwenBZ{}~ms and the 8-bit cache in \TwarmSyntheticQwenBWBitsE{}~ms, the summary in \TwarmSyntheticQwenAFBBlind{}~ms | ||||
| 69 | +(it is short), while full text still pays \TwarmSyntheticQwenAO{}~ms. Peak memory separates two phases (Table~\ref{tab:primary} sources; Figure~\ref{fig:latency}, bottom): the \emph{prefill} peak is the | ||||
| 70 | +same for every cache method as for full text (7.16~GB on the laptop with both models resident), because compression happens after the | ||||
| 71 | +document has been read---a method that compresses after prefill cannot lower the prefill peak; the \emph{decode-phase} peak then reflects the | ||||
| 72 | +resident state (6.90~GB for the dense Qwen cache, 6.74 at 8 bits, 6.55 at 1/4 retention, 6.3--6.6 for text messages), i.e., ${\approx}0.3$~GB | ||||
| 73 | +for an 8k-token Qwen cache and three times that for Llama's eight KV heads. No single denominator ranks the methods the same way; the frontier maps (Figures~\ref{fig:frontier} and | ||||
| 74 | +\ref{fig:latency}) are the result. | ||||
| 75 | + | ||||
| 76 | +\begin{table}[t]\centering\scriptsize | ||||
| 77 | +\caption{Resource accounting, synthetic family (medians over trials). Cold = build + compress/serialize + load + receiver; warm = load + | ||||
| 78 | +receiver (document state already built); bytes = serialized payload including manifest. Qwen pair on the laptop (M5 Max); Llama pair on | ||||
| 79 | +M3U96a (M3 Ultra) for this family---compare within a pair only.}\label{tab:cost} | ||||
| 80 | +\begin{tabular}{@{}lrrrrrr@{}}\toprule | ||||
| 81 | + & \multicolumn{3}{c}{Qwen2.5-3B (laptop)} & \multicolumn{3}{c}{Llama-3.2-3B (M3U96a)} \\ | ||||
| 82 | +Condition & bytes & cold ms & warm ms & bytes & cold ms & warm ms \\\midrule | ||||
| 83 | +A1 full text & \BSyntheticQwenAO & \TcoldSyntheticQwenAO & \TwarmSyntheticQwenAO & \BSyntheticLlamaAO & \TcoldSyntheticLlamaAO & \TwarmSyntheticLlamaAO \\ | ||||
| 84 | +A4 summary (blind) & \BSyntheticQwenAFBBlind & \TcoldSyntheticQwenAFBBlind & \TwarmSyntheticQwenAFBBlind & \BSyntheticLlamaAFBBlind & \TcoldSyntheticLlamaAFBBlind & \TwarmSyntheticLlamaAFBBlind \\ | ||||
| 85 | +A5 structured (blind) & \BSyntheticQwenAVBBlind & \TcoldSyntheticQwenAVBBlind & \TwarmSyntheticQwenAVBBlind & \BSyntheticLlamaAVBBlind & \TcoldSyntheticLlamaAVBBlind & \TwarmSyntheticLlamaAVBBlind \\ | ||||
| 86 | +A7 zstd text & \BSyntheticQwenASZstd & \TcoldSyntheticQwenASZstd & \TwarmSyntheticQwenASZstd & \BSyntheticLlamaASZstd & \TcoldSyntheticLlamaASZstd & \TwarmSyntheticLlamaASZstd \\ | ||||
| 87 | +B0 native cache & \BSyntheticQwenBZ & \TcoldSyntheticQwenBZ & \TwarmSyntheticQwenBZ & \BSyntheticLlamaBZ & \TcoldSyntheticLlamaBZ & \TwarmSyntheticLlamaBZ \\ | ||||
| 88 | +B1 serialized reuse & \BSyntheticQwenBO & \TcoldSyntheticQwenBO & \TwarmSyntheticQwenBO & \BSyntheticLlamaBO & \TcoldSyntheticLlamaBO & \TwarmSyntheticLlamaBO \\ | ||||
| 89 | +B2 8-bit & \BSyntheticQwenBWBitsE & \TcoldSyntheticQwenBWBitsE & \TwarmSyntheticQwenBWBitsE & \BSyntheticLlamaBWBitsE & \TcoldSyntheticLlamaBWBitsE & \TwarmSyntheticLlamaBWBitsE \\ | ||||
| 90 | +B3 sink+recent 1/4 & \BSyntheticQwenBHK & \TcoldSyntheticQwenBHK & \TwarmSyntheticQwenBHK & \BSyntheticLlamaBHK & \TcoldSyntheticLlamaBHK & \TwarmSyntheticLlamaBHK \\ | ||||
| 91 | +B5 attention 1/4 (aware) & \BSyntheticQwenBVKAware & \TcoldSyntheticQwenBVKAware & \TwarmSyntheticQwenBVKAware & \BSyntheticLlamaBVKAware & \TcoldSyntheticLlamaBVKAware & \TwarmSyntheticLlamaBVKAware \\ | ||||
| 92 | +B6 pyramid 1/4 (aware) & \BSyntheticQwenBXKAware & \TcoldSyntheticQwenBXKAware & \TwarmSyntheticQwenBXKAware & \BSyntheticLlamaBXKAware & \TcoldSyntheticLlamaBXKAware & \TwarmSyntheticLlamaBXKAware \\\bottomrule | ||||
| 93 | +\end{tabular} | ||||
| 94 | +\end{table} | ||||
| 95 | + | ||||
| 96 | +\begin{figure}[t]\centering\includegraphics[width=\textwidth]{fig3_quality_vs_latency_memory.pdf} | ||||
| 97 | +\caption{Quality against cold end-to-end latency (top) and peak MLX memory during the trial (bottom), by family, both pairs pooled.} | ||||
| 98 | +\label{fig:latency}\end{figure} | ||||
| 99 | + | ||||
| 100 | +\begin{figure}[t]\centering\includegraphics[width=\textwidth]{fig4_latency_decomposition.pdf} | ||||
| 101 | +\caption{Latency decomposition (medians of recorded spans, synthetic family, cold scenario; document build counted once). Sender generation | ||||
| 102 | +dominates the text methods that need a model; document prefill dominates the cache methods; selection and serialization are minor; the | ||||
| 103 | +pyramid cache pays a token-by-token query prefill.}\label{fig:decomp}\end{figure} | ||||
modified
paper/sections/results_handoffs.tex
+40 −1
@@ -1 +1,40 @@ | |||||
| 1 | −% pending | 1 | +\subsection{Repeated handoffs and error correction (E4)} | ||
| 2 | +\label{sec:handoffs} | ||||
| 3 | +Twenty synthetic test documents were relayed through chains of 1, 2, 4 and 8 handoffs (Figure~\ref{fig:handoffs}, Table~\ref{tab:handoffs}). | ||||
| 4 | +Only the first agent sees the document; every later agent sees only the previous message (closed) or the previous message plus metered | ||||
| 5 | +re-reads of source sentences for the project codes it mentions (repairable; at most four lookups and 1\,500 bytes per hop). Both prose (A4) | ||||
| 6 | +and structured (A5) relays were run with a homogeneous Qwen chain and with a Qwen/Llama alternating chain; after each measured hop the last | ||||
| 7 | +agent answered all fifteen question types, and the evaluator-only ledger (62 atomic facts per document) measured retention and unsupported | ||||
| 8 | +additions in each message. 7\,200 answer trials were produced. | ||||
| 9 | + | ||||
| 10 | +\begin{figure}[t]\centering\includegraphics[width=\textwidth]{fig5_handoffs.pdf} | ||||
| 11 | +\caption{Repeated handoffs on 20 synthetic test documents: retained ledger facts, unsupported numbers/identifiers per message, and question | ||||
| 12 | +accuracy after 1, 2, 4 and 8 handoffs. Solid = closed chains, dashed = repairable chains with metered source lookups; filled circles = Qwen | ||||
| 13 | +only, open squares = Qwen/Llama alternating.}\label{fig:handoffs}\end{figure} | ||||
| 14 | + | ||||
| 15 | +\begin{table}[t]\centering\scriptsize | ||||
| 16 | +\caption{Repeated handoffs (means over 20 documents; 95\,\% cluster-bootstrap CIs). Retention = share of the 62 ledger facts whose value appears | ||||
| 17 | +in the message; unsupported = numbers ($\ge$ 4 digits) or identifiers in the message that do not occur in the document; fetched = cumulative | ||||
| 18 | +bytes re-read from the source by repairable agents.}\label{tab:handoffs} | ||||
| 19 | +\adjustbox{max width=\textwidth}{\input{tables/table_handoffs}} | ||||
| 20 | +\end{table} | ||||
| 21 | + | ||||
| 22 | +\paragraph{The loss happens at the first hop; relays are nearly lossless afterwards (H5 rejected).} A 512-token prose summary retains | ||||
| 23 | +${\approx}32$\,\% of the ledger facts and supports ${\approx}40$\,\% of the answers after one handoff; after eight closed handoffs the figures are | ||||
| 24 | +${\approx}31$\,\% and ${\approx}39$\,\%---a drift of one to two points, within the intervals. Structured relays are even more stable: from hop~2 the | ||||
| 25 | +Qwen chain re-emits a byte-identical JSON (709 bytes) at every hop, a fixed point of the ``re-emit this evidence'' instruction. The | ||||
| 26 | +registered expectation of monotone decay below 70\,\% retention after four hops is rejected for both representations, and so is the | ||||
| 27 | +expectation that structured evidence would protect facts better than prose: at four handoffs the A5 chain answers 12 points \emph{fewer} | ||||
| 28 | +questions than the A4 chain (T5, paired difference $-0.12$, 95\,\% CI $[-0.21,-0.03]$, bootstrap $p=0.013$, 300 instances in 20 documents), | ||||
| 29 | +for the same reason as in the single-handoff study---the budget buys ${\approx}8$ quoted facts. | ||||
| 30 | + | ||||
| 31 | +\paragraph{Unsupported additions are rare.} Across 7\,200 relayed messages the ledger metric found no unsupported identifier and at most one | ||||
| 32 | +unsupported number in a single repairable Qwen chain (0.05 per message); the 3B agents compress by \emph{omission}, not by invention, and the | ||||
| 33 | +receiver answers ``unknown'' for omitted facts. Alternating Qwen and Llama agents neither helped nor hurt (differences within one point). | ||||
| 34 | + | ||||
| 35 | +\paragraph{Metered repair recovers a little at a growing price (H6 partially confirmed).} Allowing each relay agent to re-read the source | ||||
| 36 | +sentences for the project codes in the notes raised retention from 32 to 38\,\% and accuracy from 40 to 44\,\% for the prose chain, with no | ||||
| 37 | +further gain after the fourth hop; the cumulative fetched volume reached 5.9~kB by hop~8, i.e., about five messages' worth of traffic for a | ||||
| 38 | +four-point gain. For the structured chain the repair added two points of retention and nothing in accuracy: the agent could re-read, but the | ||||
| 39 | +re-emitted JSON did not grow. Evidence access therefore repairs what the previous message still \emph{names}; facts whose entity was already | ||||
| 40 | +dropped cannot be requested, which is the practical limit of reference-based repair without the original question. | ||||
modified
paper/sections/results_network.tex
+8 −8
@@ -21,15 +21,15 @@ deserialization at the worker; the round trip includes the worker's fresh-query | |||||
| 21 | that yields quality~0 for Qwen2.5 (Section~\ref{sec:results-frontier}) and are shown only for byte and time accounting.}\label{tab:network} | 21 | that yields quality~0 for Qwen2.5 (Section~\ref{sec:results-frontier}) and are shown only for byte and time accounting.}\label{tab:network} | ||
| 22 | \begin{tabular}{@{}llrrrrr@{}}\toprule | 22 | \begin{tabular}{@{}llrrrrr@{}}\toprule | ||
| 23 | Context class & Representation & payload (MB) & send & load & remote prefill & round trip \\\midrule | 23 | Context class & Representation & payload (MB) & send & load & remote prefill & round trip \\\midrule | ||
| 24 | −2k & text $\to$ remote prefill & 0.01 & -- & -- & \EsixTextRemotePrefillNoneTZZZPrefill & \EsixTextRemotePrefillNoneTZZZRt \\ | 24 | +2k & text $\to$ remote prefill & 0.01 & -- & -- & \EsixTextRemotePrefillNoneWZZZPrefill & \EsixTextRemotePrefillNoneWZZZRt \\ | ||
| 25 | −2k & B1 bf16 cache & \EsixBONoneTZZZBytes & \EsixBONoneTZZZSend & \EsixBONoneTZZZLoad & 0 & \EsixBONoneTZZZRt \\ | 25 | +2k & B1 bf16 cache & \EsixBONoneWZZZBytes & \EsixBONoneWZZZSend & \EsixBONoneWZZZLoad & 0 & \EsixBONoneWZZZRt \\ | ||
| 26 | −2k & B2 8-bit cache & \EsixBTENoneTZZZBytes & \EsixBTENoneTZZZSend & \EsixBTENoneTZZZLoad & 0 & \EsixBTENoneTZZZRt \\ | 26 | +2k & B2 8-bit cache & \EsixBWENoneWZZZBytes & \EsixBWENoneWZZZSend & \EsixBWENoneWZZZLoad & 0 & \EsixBWENoneWZZZRt \\ | ||
| 27 | 8k & text $\to$ remote prefill & 0.03 & -- & -- & \EsixTextRemotePrefillNoneEZZZPrefill & \EsixTextRemotePrefillNoneEZZZRt \\ | 27 | 8k & text $\to$ remote prefill & 0.03 & -- & -- & \EsixTextRemotePrefillNoneEZZZPrefill & \EsixTextRemotePrefillNoneEZZZRt \\ | ||
| 28 | 8k & B1 bf16 cache & \EsixBONoneEZZZBytes & \EsixBONoneEZZZSend & \EsixBONoneEZZZLoad & 0 & \EsixBONoneEZZZRt \\ | 28 | 8k & B1 bf16 cache & \EsixBONoneEZZZBytes & \EsixBONoneEZZZSend & \EsixBONoneEZZZLoad & 0 & \EsixBONoneEZZZRt \\ | ||
| 29 | −8k & B2 8-bit cache & \EsixBTENoneEZZZBytes & \EsixBTENoneEZZZSend & \EsixBTENoneEZZZLoad & 0 & \EsixBTENoneEZZZRt \\ | 29 | +8k & B2 8-bit cache & \EsixBWENoneEZZZBytes & \EsixBWENoneEZZZSend & \EsixBWENoneEZZZLoad & 0 & \EsixBWENoneEZZZRt \\ | ||
| 30 | −16k (${\approx}$11k tokens) & text $\to$ remote prefill & 0.06 & -- & -- & \EsixTextRemotePrefillNoneOSZZZPrefill & \EsixTextRemotePrefillNoneOSZZZRt \\ | 30 | +16k (${\approx}$11k tokens) & text $\to$ remote prefill & 0.06 & -- & -- & \EsixTextRemotePrefillNoneOXZZZPrefill & \EsixTextRemotePrefillNoneOXZZZRt \\ | ||
| 31 | −16k & B1 bf16 cache & \EsixBONoneOSZZZBytes & \EsixBONoneOSZZZSend & \EsixBONoneOSZZZLoad & 0 & \EsixBONoneOSZZZRt \\ | 31 | +16k & B1 bf16 cache & \EsixBONoneOXZZZBytes & \EsixBONoneOXZZZSend & \EsixBONoneOXZZZLoad & 0 & \EsixBONoneOXZZZRt \\ | ||
| 32 | −16k & B2 8-bit cache & \EsixBTENoneOSZZZBytes & \EsixBTENoneOSZZZSend & \EsixBTENoneOSZZZLoad & 0 & \EsixBTENoneOSZZZRt \\\bottomrule | 32 | +16k & B2 8-bit cache & \EsixBWENoneOXZZZBytes & \EsixBWENoneOXZZZSend & \EsixBWENoneOXZZZLoad & 0 & \EsixBWENoneOXZZZRt \\\bottomrule | ||
| 33 | \end{tabular} | 33 | \end{tabular} | ||
| 34 | \end{table} | 34 | \end{table} | ||
| 35 | 35 | ||||
@@ -37,7 +37,7 @@ Three observations follow. First, the serialized bf16 cache is three to four ord | |||||
| 37 | (\EsixBONoneEZZZBytes{}~MB versus 29~kB at 8k tokens), and zstd recovers only ${\approx}20$\,\% of it (high-entropy payload; H8), while packed | 37 | (\EsixBONoneEZZZBytes{}~MB versus 29~kB at 8k tokens), and zstd recovers only ${\approx}20$\,\% of it (high-entropy payload; H8), while packed | ||
| 38 | 8-bit quantization halves it. Second, on this link and with this receiver, moving the cache is nevertheless \emph{faster} than re-reading | 38 | 8-bit quantization halves it. Second, on this link and with this receiver, moving the cache is nevertheless \emph{faster} than re-reading | ||
| 39 | the text at every context length we measured: at 8k tokens the bf16 transfer answers in \EsixBONoneEZZZRt{}~ms against | 39 | the text at every context length we measured: at 8k tokens the bf16 transfer answers in \EsixBONoneEZZZRt{}~ms against | ||
| 40 | −\EsixTextRemotePrefillNoneEZZZRt{}~ms for remote prefill, and the 8-bit cache in \EsixBTENoneEZZZRt{}~ms, because the M3~Ultra receiver prefills | 40 | +\EsixTextRemotePrefillNoneEZZZRt{}~ms for remote prefill, and the 8-bit cache in \EsixBWENoneEZZZRt{}~ms, because the M3~Ultra receiver prefills | ||
| 41 | Qwen2.5-3B at ${\approx}0.44$~ms per token (\EsixTextRemotePrefillNoneEZZZPrefill{}~ms for 8k) whereas 1~GbE moves the per-token cache | 41 | Qwen2.5-3B at ${\approx}0.44$~ms per token (\EsixTextRemotePrefillNoneEZZZPrefill{}~ms for 8k) whereas 1~GbE moves the per-token cache | ||
| 42 | (${\approx}26$~kB bf16, ${\approx}14$~kB at 8 bits) in ${\approx}0.23$ and ${\approx}0.12$~ms. The break-even therefore depends on the ratio | 42 | (${\approx}26$~kB bf16, ${\approx}14$~kB at 8 bits) in ${\approx}0.23$ and ${\approx}0.12$~ms. The break-even therefore depends on the ratio | ||
| 43 | of receiver prefill time to link time per token, which the right panel makes explicit: a faster receiver (the laptop prefills 8k tokens in | 43 | of receiver prefill time to link time per token, which the right panel makes explicit: a faster receiver (the laptop prefills 8k tokens in | ||
added
paper/tables/table_fanin.tex
+16 −0
@@ -0,0 +1,16 @@ | |||||
| 1 | +\begin{tabular}{@{}lrrrrr@{}} | ||||
| 2 | +\toprule | ||||
| 3 | +method & aggregation & multi\_hop & revision & temporal & unanswerable \\ | ||||
| 4 | +\midrule | ||||
| 5 | +cache concat (neg. control) k=2 & 0 [0,0] & 70 [57,82] & 50 [35,65] & 55 [35,75] & 100 [100,100] \\ | ||||
| 6 | +cache concat (neg. control) k=4 & 0 [0,0] & 52 [40,68] & 25 [12,40] & 40 [20,60] & 98 [91,100] \\ | ||||
| 7 | +concat A4 k=2 & 0 [0,0] & 92 [85,99] & 70 [55,85] & 60 [35,80] & 100 [100,100] \\ | ||||
| 8 | +concat A4 k=4 & 0 [0,0] & 92 [85,100] & 65 [50,80] & 65 [45,85] & 100 [100,100] \\ | ||||
| 9 | +full context k=2 & 0 [0,0] & 98 [92,100] & 60 [50,71] & 70 [50,90] & 100 [100,100] \\ | ||||
| 10 | +full context k=4 & 0 [0,0] & 95 [88,100] & 62 [50,75] & 50 [30,75] & 100 [100,100] \\ | ||||
| 11 | +merge A5 k=2 & 0 [0,0] & 22 [12,35] & 15 [5,25] & 55 [35,80] & 100 [100,100] \\ | ||||
| 12 | +merge A5 k=4 & 0 [0,0] & 32 [18,48] & 45 [35,55] & 45 [25,65] & 98 [92,100] \\ | ||||
| 13 | +shared memory A6 k=2 & 0 [0,0] & 38 [22,52] & 45 [30,62] & 35 [20,55] & 100 [100,100] \\ | ||||
| 14 | +shared memory A6 k=4 & 0 [0,0] & 60 [45,75] & 68 [50,85] & 45 [25,65] & 100 [100,100] \\ | ||||
| 15 | +\bottomrule | ||||
| 16 | +\end{tabular} | ||||
added
paper/tables/table_handoffs.tex
+30 −0
@@ -0,0 +1,30 @@ | |||||
| 1 | +\begin{tabular}{@{}llrrrrr@{}} | ||||
| 2 | +\toprule | ||||
| 3 | +chain & handoffs & accuracy (\\%) & retained facts (\\%) & unsupported/msg & message B & fetched B \\ | ||||
| 4 | +\midrule | ||||
| 5 | +A4 closed Qwen/Llama alt. & 1 & 40 [31,48] & 32 [24,40] & 0.00 & 1,335.10 & 0.00 \\ | ||||
| 6 | +A4 closed Qwen/Llama alt. & 2 & 40 [33,48] & 32 [24,40] & 0.00 & 1,292.70 & 0.00 \\ | ||||
| 7 | +A4 closed Qwen/Llama alt. & 4 & 40 [32,48] & 31 [23,39] & 0.00 & 1,204.35 & 0.00 \\ | ||||
| 8 | +A4 closed Qwen/Llama alt. & 8 & 39 [29,48] & 31 [22,39] & 0.00 & 1,111.65 & 0.00 \\ | ||||
| 9 | +A4 closed Qwen & 1 & 40 [31,48] & 32 [24,40] & 0.00 & 1,335.10 & 0.00 \\ | ||||
| 10 | +A4 closed Qwen & 2 & 39 [30,47] & 32 [24,40] & 0.00 & 1,200.35 & 0.00 \\ | ||||
| 11 | +A4 closed Qwen & 4 & 39 [30,47] & 31 [24,39] & 0.00 & 1,175.65 & 0.00 \\ | ||||
| 12 | +A4 closed Qwen & 8 & 39 [30,48] & 31 [24,39] & 0.00 & 1,174.70 & 0.00 \\ | ||||
| 13 | +A4 repairable Qwen & 1 & 40 [31,48] & 32 [24,40] & 0.00 & 1,335.10 & 0.00 \\ | ||||
| 14 | +A4 repairable Qwen & 2 & 42 [35,50] & 36 [28,42] & 0.05 & 1,283.20 & 844.10 \\ | ||||
| 15 | +A4 repairable Qwen & 4 & 43 [36,51] & 38 [31,44] & 0.05 & 1,214.45 & 2,532.30 \\ | ||||
| 16 | +A4 repairable Qwen & 8 & 44 [36,51] & 38 [31,44] & 0.05 & 1,213.50 & 5,908.70 \\ | ||||
| 17 | +A5 closed Qwen/Llama alt. & 1 & 27 [25,30] & 17 [15,20] & 0.00 & 751.85 & 0.00 \\ | ||||
| 18 | +A5 closed Qwen/Llama alt. & 2 & 29 [27,33] & 20 [18,22] & 0.00 & 952.65 & 0.00 \\ | ||||
| 19 | +A5 closed Qwen/Llama alt. & 4 & 29 [26,32] & 20 [18,22] & 0.00 & 977.35 & 0.00 \\ | ||||
| 20 | +A5 closed Qwen/Llama alt. & 8 & 29 [26,32] & 20 [18,22] & 0.00 & 977.35 & 0.00 \\ | ||||
| 21 | +A5 closed Qwen & 1 & 27 [25,30] & 17 [15,20] & 0.00 & 751.85 & 0.00 \\ | ||||
| 22 | +A5 closed Qwen & 2 & 26 [23,29] & 17 [15,20] & 0.00 & 709.10 & 0.00 \\ | ||||
| 23 | +A5 closed Qwen & 4 & 27 [24,30] & 17 [15,20] & 0.00 & 709.10 & 0.00 \\ | ||||
| 24 | +A5 closed Qwen & 8 & 27 [24,30] & 17 [15,20] & 0.00 & 709.10 & 0.00 \\ | ||||
| 25 | +A5 repairable Qwen & 1 & 27 [25,30] & 17 [15,20] & 0.00 & 751.85 & 0.00 \\ | ||||
| 26 | +A5 repairable Qwen & 2 & 26 [23,29] & 19 [16,21] & 0.00 & 710.50 & 847.60 \\ | ||||
| 27 | +A5 repairable Qwen & 4 & 26 [24,30] & 20 [17,22] & 0.00 & 743.70 & 2,356.10 \\ | ||||
| 28 | +A5 repairable Qwen & 8 & 26 [24,30] & 20 [17,22] & 0.00 & 743.70 & 5,373.10 \\ | ||||
| 29 | +\bottomrule | ||||
| 30 | +\end{tabular} | ||||
added
paper/tables/table_primary.tex
+28 −0
@@ -0,0 +1,28 @@ | |||||
| 1 | +\begin{tabular}{@{}lrrrrrrrr@{}} | ||||
| 2 | +\toprule | ||||
| 3 | +condition & synthetic Qwen & synthetic Llama & exec Qwen & exec Llama & qasper Qwen & qasper Llama & 2wikimqa Qwen & 2wikimqa Llama \\ | ||||
| 4 | +\midrule | ||||
| 5 | +A0 & 0 [0,0] & 0 [0,0] & 0 [0,0] & 0 [0,0] & 4 [1,10] & 5 [1,12] & 11 [4,21] & 6 [0,14] \\ | ||||
| 6 | +A1 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 39 [25,54] & 33 [20,47] \\ | ||||
| 7 | +A2 512 & 20 [16,23] & 20 [17,24] & 100 [100,100] & 70 [55,85] & 9 [3,16] & 7 [2,13] & 12 [2,22] & 7 [1,15] \\ | ||||
| 8 | +A3 512 aware & 97 [94,99] & 100 [98,100] & 50 [35,65] & 20 [8,32] & 20 [11,29] & 24 [15,35] & 21 [11,33] & 16 [7,27] \\ | ||||
| 9 | +A3 512 blind & 38 [36,40] & 40 [40,42] & 100 [100,100] & 98 [92,100] & 18 [8,29] & 14 [7,23] & 11 [2,21] & 3 [0,10] \\ | ||||
| 10 | +A4 512 aware & 94 [89,98] & 83 [77,90] & -- & -- & -- & -- & -- & -- \\ | ||||
| 11 | +A4 512 blind & 38 [29,46] & 44 [38,50] & 38 [22,52] & 82 [70,92] & 17 [9,27] & 20 [11,30] & 20 [10,32] & 16 [7,27] \\ | ||||
| 12 | +A5 512 aware & 100 [100,100] & 95 [91,98] & -- & -- & -- & -- & -- & -- \\ | ||||
| 13 | +A5 512 blind & 15 [12,18] & 12 [9,16] & 12 [2,22] & 0 [0,0] & 9 [2,18] & 5 [1,11] & 12 [4,23] & 6 [0,13] \\ | ||||
| 14 | +A6 512 blind & 18 [14,22] & 18 [14,22] & 22 [10,35] & 15 [5,28] & 9 [2,17] & 7 [2,13] & 11 [2,22] & 10 [2,19] \\ | ||||
| 15 | +A7 zstd & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 39 [25,54] & 33 [20,47] \\ | ||||
| 16 | +A8 512 blind & 14 [9,18] & 0 [0,0] & 0 [0,0] & 0 [0,0] & 17 [10,25] & 23 [13,33] & 6 [0,14] & 8 [0,18] \\ | ||||
| 17 | +B0 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 36 [22,50] & 33 [20,47] \\ | ||||
| 18 | +B1 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 36 [22,50] & 33 [20,47] \\ | ||||
| 19 | +B2 bits=4 & 0 [0,0] & 98 [94,100] & 0 [0,0] & 100 [100,100] & 1 [0,2] & 25 [15,36] & 0 [0,1] & 22 [10,34] \\ | ||||
| 20 | +B2 bits=8 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 98 [92,100] & 38 [25,50] & 25 [15,36] & 36 [22,50] & 33 [20,47] \\ | ||||
| 21 | +B3 1/4 & 20 [18,23] & 18 [16,21] & 0 [0,0] & 0 [0,0] & 19 [10,29] & 16 [9,25] & 39 [25,55] & 32 [19,46] \\ | ||||
| 22 | +B4 1/4 & 0 [0,0] & 0 [0,0] & 0 [0,0] & 0 [0,0] & 6 [2,13] & 7 [1,16] & 1 [0,2] & 0 [0,0] \\ | ||||
| 23 | +B5 1/4 aware & 78 [72,83] & 98 [96,100] & 0 [0,0] & 0 [0,0] & 29 [19,40] & 24 [15,34] & 34 [20,48] & 32 [19,46] \\ | ||||
| 24 | +B5 1/4 blind & 12 [8,17] & 19 [12,26] & 0 [0,0] & 0 [0,0] & 21 [11,32] & 19 [10,29] & 31 [18,45] & 28 [16,42] \\ | ||||
| 25 | +B6 1/4 aware & 66 [61,70] & 98 [95,100] & 0 [0,0] & 0 [0,0] & 27 [16,38] & 24 [15,34] & 36 [23,51] & 29 [16,44] \\ | ||||
| 26 | +B9 bits=8 1/4 att aware & 78 [73,84] & 98 [96,100] & 0 [0,0] & 0 [0,0] & 28 [18,40] & 24 [14,34] & 35 [22,49] & 32 [19,46] \\ | ||||
| 27 | +\bottomrule | ||||
| 28 | +\end{tabular} | ||||
modified
results/figures/fig2_quality_vs_bytes.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig3_quality_vs_latency_memory.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig3_quality_vs_latency_memory.png
+0 −0
Binary file not shown.
modified
results/figures/fig4_latency_decomposition.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig4_latency_decomposition.png
+0 −0
Binary file not shown.
modified
results/figures/fig5_handoffs.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig5_handoffs.png
+0 −0
Binary file not shown.
modified
results/figures/fig6_breakeven.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig7_router.pdf
+0 −0
Binary file not shown.
modified
results/figures/figA_quality_vs_bytes_aware.pdf
+0 −0
Binary file not shown.
modified
results/figures/figA_quality_vs_bytes_blind.pdf
+0 −0
Binary file not shown.
modified
results/provenance.json
+25 −25
@@ -4,7 +4,7 @@ | |||||
| 4 | "runs/raw/E1_core.jsonl" | 4 | "runs/raw/E1_core.jsonl" | ||
| 5 | ], | 5 | ], | ||
| 6 | "script": "src/wp30/analysis/analyze.py", | 6 | "script": "src/wp30/analysis/analyze.py", | ||
| 7 | − "generated_utc": "2026-10-30T08:22:14.538915Z", | 7 | + "generated_utc": "2026-10-30T08:41:10.888608Z", | ||
| 8 | "note": "per-condition quality (cluster bootstrap CI) and resource medians" | 8 | "note": "per-condition quality (cluster bootstrap CI) and resource medians" | ||
| 9 | }, | 9 | }, | ||
| 10 | "results/tables/E1_core_failures.csv": { | 10 | "results/tables/E1_core_failures.csv": { | ||
@@ -12,7 +12,7 @@ | |||||
| 12 | "runs/raw/E1_core.jsonl" | 12 | "runs/raw/E1_core.jsonl" | ||
| 13 | ], | 13 | ], | ||
| 14 | "script": "src/wp30/analysis/analyze.py", | 14 | "script": "src/wp30/analysis/analyze.py", | ||
| 15 | − "generated_utc": "2026-10-30T08:22:14.540728Z", | 15 | + "generated_utc": "2026-10-30T08:41:10.897925Z", | ||
| 16 | "note": "attempt status counts by method" | 16 | "note": "attempt status counts by method" | ||
| 17 | }, | 17 | }, | ||
| 18 | "results/tables/E1_core_by_question_type.csv": { | 18 | "results/tables/E1_core_by_question_type.csv": { | ||
@@ -20,7 +20,7 @@ | |||||
| 20 | "runs/raw/E1_core.jsonl" | 20 | "runs/raw/E1_core.jsonl" | ||
| 21 | ], | 21 | ], | ||
| 22 | "script": "src/wp30/analysis/analyze.py", | 22 | "script": "src/wp30/analysis/analyze.py", | ||
| 23 | − "generated_utc": "2026-10-30T08:22:14.760371Z", | 23 | + "generated_utc": "2026-10-30T08:41:11.023256Z", | ||
| 24 | "note": "synthetic accuracy by question type" | 24 | "note": "synthetic accuracy by question type" | ||
| 25 | }, | 25 | }, | ||
| 26 | "results/tables/E1_core_primary_tests.csv": { | 26 | "results/tables/E1_core_primary_tests.csv": { | ||
@@ -28,7 +28,7 @@ | |||||
| 28 | "runs/raw/E1_core.jsonl" | 28 | "runs/raw/E1_core.jsonl" | ||
| 29 | ], | 29 | ], | ||
| 30 | "script": "src/wp30/analysis/analyze.py", | 30 | "script": "src/wp30/analysis/analyze.py", | ||
| 31 | − "generated_utc": "2026-10-30T08:22:14.878795Z", | 31 | + "generated_utc": "2026-10-30T08:41:11.097268Z", | ||
| 32 | "note": "registered primary comparisons, paired, cluster bootstrap, Holm" | 32 | "note": "registered primary comparisons, paired, cluster bootstrap, Holm" | ||
| 33 | }, | 33 | }, | ||
| 34 | "results/figures/fig2_quality_vs_bytes.pdf": { | 34 | "results/figures/fig2_quality_vs_bytes.pdf": { | ||
@@ -36,7 +36,7 @@ | |||||
| 36 | "runs/raw/E1_core.jsonl" | 36 | "runs/raw/E1_core.jsonl" | ||
| 37 | ], | 37 | ], | ||
| 38 | "script": "src/wp30/analysis/analyze.py", | 38 | "script": "src/wp30/analysis/analyze.py", | ||
| 39 | − "generated_utc": "2026-10-30T08:22:15.688835Z", | 39 | + "generated_utc": "2026-10-30T08:41:11.754908Z", | ||
| 40 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 40 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 41 | }, | 41 | }, | ||
| 42 | "results/figures/fig2_quality_vs_bytes.png": { | 42 | "results/figures/fig2_quality_vs_bytes.png": { | ||
@@ -44,7 +44,7 @@ | |||||
| 44 | "runs/raw/E1_core.jsonl" | 44 | "runs/raw/E1_core.jsonl" | ||
| 45 | ], | 45 | ], | ||
| 46 | "script": "src/wp30/analysis/analyze.py", | 46 | "script": "src/wp30/analysis/analyze.py", | ||
| 47 | − "generated_utc": "2026-10-30T08:22:15.905436Z", | 47 | + "generated_utc": "2026-10-30T08:41:11.951700Z", | ||
| 48 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 48 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 49 | }, | 49 | }, | ||
| 50 | "results/figures/figA_quality_vs_bytes_blind.pdf": { | 50 | "results/figures/figA_quality_vs_bytes_blind.pdf": { | ||
@@ -52,7 +52,7 @@ | |||||
| 52 | "runs/raw/E1_core.jsonl" | 52 | "runs/raw/E1_core.jsonl" | ||
| 53 | ], | 53 | ], | ||
| 54 | "script": "src/wp30/analysis/analyze.py", | 54 | "script": "src/wp30/analysis/analyze.py", | ||
| 55 | − "generated_utc": "2026-10-30T08:22:16.400431Z", | 55 | + "generated_utc": "2026-10-30T08:41:12.396339Z", | ||
| 56 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 56 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 57 | }, | 57 | }, | ||
| 58 | "results/figures/figA_quality_vs_bytes_blind.png": { | 58 | "results/figures/figA_quality_vs_bytes_blind.png": { | ||
@@ -60,7 +60,7 @@ | |||||
| 60 | "runs/raw/E1_core.jsonl" | 60 | "runs/raw/E1_core.jsonl" | ||
| 61 | ], | 61 | ], | ||
| 62 | "script": "src/wp30/analysis/analyze.py", | 62 | "script": "src/wp30/analysis/analyze.py", | ||
| 63 | − "generated_utc": "2026-10-30T08:22:16.572977Z", | 63 | + "generated_utc": "2026-10-30T08:41:12.558258Z", | ||
| 64 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 64 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 65 | }, | 65 | }, | ||
| 66 | "results/figures/figA_quality_vs_bytes_aware.pdf": { | 66 | "results/figures/figA_quality_vs_bytes_aware.pdf": { | ||
@@ -68,7 +68,7 @@ | |||||
| 68 | "runs/raw/E1_core.jsonl" | 68 | "runs/raw/E1_core.jsonl" | ||
| 69 | ], | 69 | ], | ||
| 70 | "script": "src/wp30/analysis/analyze.py", | 70 | "script": "src/wp30/analysis/analyze.py", | ||
| 71 | − "generated_utc": "2026-10-30T08:22:16.948411Z", | 71 | + "generated_utc": "2026-10-30T08:41:12.888916Z", | ||
| 72 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 72 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 73 | }, | 73 | }, | ||
| 74 | "results/figures/figA_quality_vs_bytes_aware.png": { | 74 | "results/figures/figA_quality_vs_bytes_aware.png": { | ||
@@ -76,7 +76,7 @@ | |||||
| 76 | "runs/raw/E1_core.jsonl" | 76 | "runs/raw/E1_core.jsonl" | ||
| 77 | ], | 77 | ], | ||
| 78 | "script": "src/wp30/analysis/analyze.py", | 78 | "script": "src/wp30/analysis/analyze.py", | ||
| 79 | − "generated_utc": "2026-10-30T08:22:17.136598Z", | 79 | + "generated_utc": "2026-10-30T08:41:13.061312Z", | ||
| 80 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 80 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 81 | }, | 81 | }, | ||
| 82 | "results/figures/fig3_quality_vs_latency_memory.pdf": { | 82 | "results/figures/fig3_quality_vs_latency_memory.pdf": { | ||
@@ -84,7 +84,7 @@ | |||||
| 84 | "runs/raw/E1_core.jsonl" | 84 | "runs/raw/E1_core.jsonl" | ||
| 85 | ], | 85 | ], | ||
| 86 | "script": "src/wp30/analysis/analyze.py", | 86 | "script": "src/wp30/analysis/analyze.py", | ||
| 87 | − "generated_utc": "2026-10-30T08:22:17.472811Z", | 87 | + "generated_utc": "2026-10-30T08:41:13.355100Z", | ||
| 88 | "note": "" | 88 | "note": "" | ||
| 89 | }, | 89 | }, | ||
| 90 | "results/figures/fig3_quality_vs_latency_memory.png": { | 90 | "results/figures/fig3_quality_vs_latency_memory.png": { | ||
@@ -92,7 +92,7 @@ | |||||
| 92 | "runs/raw/E1_core.jsonl" | 92 | "runs/raw/E1_core.jsonl" | ||
| 93 | ], | 93 | ], | ||
| 94 | "script": "src/wp30/analysis/analyze.py", | 94 | "script": "src/wp30/analysis/analyze.py", | ||
| 95 | − "generated_utc": "2026-10-30T08:22:17.662871Z", | 95 | + "generated_utc": "2026-10-30T08:41:13.527311Z", | ||
| 96 | "note": "" | 96 | "note": "" | ||
| 97 | }, | 97 | }, | ||
| 98 | "results/figures/fig4_latency_decomposition.pdf": { | 98 | "results/figures/fig4_latency_decomposition.pdf": { | ||
@@ -100,7 +100,7 @@ | |||||
| 100 | "runs/raw/E1_core.jsonl" | 100 | "runs/raw/E1_core.jsonl" | ||
| 101 | ], | 101 | ], | ||
| 102 | "script": "src/wp30/analysis/analyze.py", | 102 | "script": "src/wp30/analysis/analyze.py", | ||
| 103 | − "generated_utc": "2026-10-30T08:22:17.739355Z", | 103 | + "generated_utc": "2026-10-30T08:41:13.606317Z", | ||
| 104 | "note": "" | 104 | "note": "" | ||
| 105 | }, | 105 | }, | ||
| 106 | "results/figures/fig4_latency_decomposition.png": { | 106 | "results/figures/fig4_latency_decomposition.png": { | ||
@@ -108,7 +108,7 @@ | |||||
| 108 | "runs/raw/E1_core.jsonl" | 108 | "runs/raw/E1_core.jsonl" | ||
| 109 | ], | 109 | ], | ||
| 110 | "script": "src/wp30/analysis/analyze.py", | 110 | "script": "src/wp30/analysis/analyze.py", | ||
| 111 | − "generated_utc": "2026-10-30T08:22:17.782128Z", | 111 | + "generated_utc": "2026-10-30T08:41:13.663220Z", | ||
| 112 | "note": "" | 112 | "note": "" | ||
| 113 | }, | 113 | }, | ||
| 114 | "results/figures/fig5_handoffs.pdf": { | 114 | "results/figures/fig5_handoffs.pdf": { | ||
@@ -116,7 +116,7 @@ | |||||
| 116 | "runs/raw/E4_core.jsonl" | 116 | "runs/raw/E4_core.jsonl" | ||
| 117 | ], | 117 | ], | ||
| 118 | "script": "src/wp30/analysis/analyze.py", | 118 | "script": "src/wp30/analysis/analyze.py", | ||
| 119 | − "generated_utc": "2026-10-30T08:22:21.811881Z", | 119 | + "generated_utc": "2026-10-30T08:41:18.022870Z", | ||
| 120 | "note": "means over documents; chains defined in configs/chains*.yaml" | 120 | "note": "means over documents; chains defined in configs/chains*.yaml" | ||
| 121 | }, | 121 | }, | ||
| 122 | "results/figures/fig5_handoffs.png": { | 122 | "results/figures/fig5_handoffs.png": { | ||
@@ -124,7 +124,7 @@ | |||||
| 124 | "runs/raw/E4_core.jsonl" | 124 | "runs/raw/E4_core.jsonl" | ||
| 125 | ], | 125 | ], | ||
| 126 | "script": "src/wp30/analysis/analyze.py", | 126 | "script": "src/wp30/analysis/analyze.py", | ||
| 127 | − "generated_utc": "2026-10-30T08:22:21.866054Z", | 127 | + "generated_utc": "2026-10-30T08:41:18.082563Z", | ||
| 128 | "note": "means over documents; chains defined in configs/chains*.yaml" | 128 | "note": "means over documents; chains defined in configs/chains*.yaml" | ||
| 129 | }, | 129 | }, | ||
| 130 | "results/tables/E4_core_handoffs.csv": { | 130 | "results/tables/E4_core_handoffs.csv": { | ||
@@ -132,7 +132,7 @@ | |||||
| 132 | "runs/raw/E4_core.jsonl" | 132 | "runs/raw/E4_core.jsonl" | ||
| 133 | ], | 133 | ], | ||
| 134 | "script": "src/wp30/analysis/analyze.py", | 134 | "script": "src/wp30/analysis/analyze.py", | ||
| 135 | − "generated_utc": "2026-10-30T08:22:21.965647Z", | 135 | + "generated_utc": "2026-10-30T08:41:18.179059Z", | ||
| 136 | "note": "repeated handoffs" | 136 | "note": "repeated handoffs" | ||
| 137 | }, | 137 | }, | ||
| 138 | "results/tables/E4_core_h4_primary_tests.csv": { | 138 | "results/tables/E4_core_h4_primary_tests.csv": { | ||
@@ -140,7 +140,7 @@ | |||||
| 140 | "runs/raw/E4_core.jsonl" | 140 | "runs/raw/E4_core.jsonl" | ||
| 141 | ], | 141 | ], | ||
| 142 | "script": "src/wp30/analysis/analyze.py", | 142 | "script": "src/wp30/analysis/analyze.py", | ||
| 143 | − "generated_utc": "2026-10-30T08:22:21.977607Z", | 143 | + "generated_utc": "2026-10-30T08:41:18.190264Z", | ||
| 144 | "note": "registered primary comparisons, paired, cluster bootstrap, Holm" | 144 | "note": "registered primary comparisons, paired, cluster bootstrap, Holm" | ||
| 145 | }, | 145 | }, | ||
| 146 | "results/tables/E5_core_fanin.csv": { | 146 | "results/tables/E5_core_fanin.csv": { | ||
@@ -148,7 +148,7 @@ | |||||
| 148 | "runs/raw/E5_core.jsonl" | 148 | "runs/raw/E5_core.jsonl" | ||
| 149 | ], | 149 | ], | ||
| 150 | "script": "src/wp30/analysis/analyze.py", | 150 | "script": "src/wp30/analysis/analyze.py", | ||
| 151 | − "generated_utc": "2026-10-30T08:22:22.071683Z", | 151 | + "generated_utc": "2026-10-30T08:41:18.294190Z", | ||
| 152 | "note": "fan-in by method and question type" | 152 | "note": "fan-in by method and question type" | ||
| 153 | }, | 153 | }, | ||
| 154 | "results/figures/fig6_breakeven.pdf": { | 154 | "results/figures/fig6_breakeven.pdf": { | ||
@@ -156,7 +156,7 @@ | |||||
| 156 | "runs/raw/E6_core.jsonl" | 156 | "runs/raw/E6_core.jsonl" | ||
| 157 | ], | 157 | ], | ||
| 158 | "script": "src/wp30/analysis/analyze.py", | 158 | "script": "src/wp30/analysis/analyze.py", | ||
| 159 | − "generated_utc": "2026-10-30T08:22:22.167477Z", | 159 | + "generated_utc": "2026-10-30T08:41:18.383673Z", | ||
| 160 | "note": "left = measured (medians, p25-p75); right = analytic model from measured bandwidth and prefill slope; dashed 10 Gb/s is hypothetical" | 160 | "note": "left = measured (medians, p25-p75); right = analytic model from measured bandwidth and prefill slope; dashed 10 Gb/s is hypothetical" | ||
| 161 | }, | 161 | }, | ||
| 162 | "results/figures/fig6_breakeven.png": { | 162 | "results/figures/fig6_breakeven.png": { | ||
@@ -164,7 +164,7 @@ | |||||
| 164 | "runs/raw/E6_core.jsonl" | 164 | "runs/raw/E6_core.jsonl" | ||
| 165 | ], | 165 | ], | ||
| 166 | "script": "src/wp30/analysis/analyze.py", | 166 | "script": "src/wp30/analysis/analyze.py", | ||
| 167 | − "generated_utc": "2026-10-30T08:22:22.242714Z", | 167 | + "generated_utc": "2026-10-30T08:41:18.456745Z", | ||
| 168 | "note": "left = measured (medians, p25-p75); right = analytic model from measured bandwidth and prefill slope; dashed 10 Gb/s is hypothetical" | 168 | "note": "left = measured (medians, p25-p75); right = analytic model from measured bandwidth and prefill slope; dashed 10 Gb/s is hypothetical" | ||
| 169 | }, | 169 | }, | ||
| 170 | "results/tables/E6_network.csv": { | 170 | "results/tables/E6_network.csv": { | ||
@@ -172,7 +172,7 @@ | |||||
| 172 | "runs/raw/E6_core.jsonl" | 172 | "runs/raw/E6_core.jsonl" | ||
| 173 | ], | 173 | ], | ||
| 174 | "script": "src/wp30/analysis/analyze.py", | 174 | "script": "src/wp30/analysis/analyze.py", | ||
| 175 | − "generated_utc": "2026-10-30T08:22:22.247935Z", | 175 | + "generated_utc": "2026-10-30T08:41:18.462390Z", | ||
| 176 | "note": "two-node transfer measurements" | 176 | "note": "two-node transfer measurements" | ||
| 177 | }, | 177 | }, | ||
| 178 | "results/tables/ED_hosted.csv": { | 178 | "results/tables/ED_hosted.csv": { | ||
@@ -180,7 +180,7 @@ | |||||
| 180 | "runs/raw/ED_hosted_core.jsonl" | 180 | "runs/raw/ED_hosted_core.jsonl" | ||
| 181 | ], | 181 | ], | ||
| 182 | "script": "src/wp30/analysis/analyze.py", | 182 | "script": "src/wp30/analysis/analyze.py", | ||
| 183 | − "generated_utc": "2026-10-30T08:22:22.319194Z", | 183 | + "generated_utc": "2026-10-30T08:41:18.529003Z", | ||
| 184 | "note": "hosted receivers; cost estimated from provider price tables" | 184 | "note": "hosted receivers; cost estimated from provider price tables" | ||
| 185 | }, | 185 | }, | ||
| 186 | "results/figures/fig7_router.pdf": { | 186 | "results/figures/fig7_router.pdf": { | ||
@@ -190,7 +190,7 @@ | |||||
| 190 | "runs/checkpoints/router_policy.json" | 190 | "runs/checkpoints/router_policy.json" | ||
| 191 | ], | 191 | ], | ||
| 192 | "script": "src/wp30/analysis/analyze.py", | 192 | "script": "src/wp30/analysis/analyze.py", | ||
| 193 | − "generated_utc": "2026-10-30T08:22:22.416428Z", | 193 | + "generated_utc": "2026-10-30T08:41:18.669288Z", | ||
| 194 | "note": "oracle = infeasible upper reference" | 194 | "note": "oracle = infeasible upper reference" | ||
| 195 | }, | 195 | }, | ||
| 196 | "results/figures/fig7_router.png": { | 196 | "results/figures/fig7_router.png": { | ||
@@ -200,7 +200,7 @@ | |||||
| 200 | "runs/checkpoints/router_policy.json" | 200 | "runs/checkpoints/router_policy.json" | ||
| 201 | ], | 201 | ], | ||
| 202 | "script": "src/wp30/analysis/analyze.py", | 202 | "script": "src/wp30/analysis/analyze.py", | ||
| 203 | − "generated_utc": "2026-10-30T08:22:22.507187Z", | 203 | + "generated_utc": "2026-10-30T08:41:18.747352Z", | ||
| 204 | "note": "oracle = infeasible upper reference" | 204 | "note": "oracle = infeasible upper reference" | ||
| 205 | } | 205 | } | ||
| 206 | } | 206 | } | ||
| \ No newline at end of file | |||||
modified
results/tables/E1_core_primary.csv
+165 −165
@@ -1,165 +1,165 @@ | |||||
| 1 | −family,pair,condition,method,access,n,n_docs,quality,q_lo,q_hi,success_rate,payload_bytes_median,cache_bytes_median,cold_ms_p50,warm_ms_p50,amortized_ms_p50,ttft_ms_p50,peak_decode_mem_median,fetched_bytes_mean | 1 | +family,pair,condition,method,access,n,n_docs,quality,q_lo,q_hi,success_rate,payload_bytes_median,cache_bytes_median,cold_ms_p50,warm_ms_p50,amortized_ms_p50,ttft_ms_p50,peak_decode_mem_median,peak_cold_mem_median,fetched_bytes_mean | ||
| 2 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.0,0.0,0.0,1.0,0.0,,1258.4582085255533,1258.450958528556,1258.4582085255533,11.510187992826104,6547584464.0,0.0 | 2 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.0,0.0,0.0,1.0,0.0,,1258.4582085255533,1258.450958528556,1258.4582085255533,11.510187992826104,6547584464.0,6547584464.0,0.0 | ||
| 3 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.95,0.875,1.0,1.0,7817.0,,1986.9115210021846,1986.9039590121247,1986.9115210021846,12.162082944996655,7123374444.0,0.0 | 3 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.95,0.875,1.0,1.0,7817.0,,1986.9115210021846,1986.9039590121247,1986.9115210021846,12.162082944996655,7123374444.0,7123374444.0,0.0 | ||
| 4 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.7,0.55,0.85,1.0,2158.5,,1410.8660004567355,1409.1922294464894,1410.8660004567355,11.836166551802307,6810762776.0,0.0 | 4 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.7,0.55,0.85,1.0,2158.5,,1410.8660004567355,1409.1922294464894,1410.8660004567355,11.836166551802307,6810762776.0,6810762776.0,0.0 | ||
| 5 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.2,0.075,0.325,1.0,2349.0,,1423.6712495330721,1422.393708024174,1423.6712495330721,11.827166483271867,6805962264.0,0.0 | 5 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.2,0.075,0.325,1.0,2349.0,,1423.6712495330721,1422.393708024174,1423.6712495330721,11.827166483271867,6805962264.0,6805962264.0,0.0 | ||
| 6 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.975,0.925,1.0,1.0,1560.0,,1329.3726665433496,1327.518479025457,1329.3726665433496,11.832229502033442,6801636888.0,0.0 | 6 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.975,0.925,1.0,1.0,1560.0,,1329.3726665433496,1327.518479025457,1329.3726665433496,11.832229502033442,6801636888.0,6801636888.0,0.0 | ||
| 7 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.825,0.7,0.925,1.0,1664.0,,8203.995228977874,1488.7063130154274,8203.995228977874,11.814270517788827,6840548888.0,0.0 | 7 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.825,0.7,0.925,1.0,1664.0,,8203.995228977874,1488.7063130154274,8203.995228977874,11.814270517788827,6840548888.0,6840548888.0,0.0 | ||
| 8 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.0,0.0,0.0,1.0,1245.5,,8283.329896512441,1541.5113129420206,8283.329896512441,11.789770913310349,6766525528.0,0.0 | 8 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.0,0.0,0.0,1.0,1245.5,,8283.329896512441,1541.5113129420206,8283.329896512441,11.789770913310349,6766525528.0,6766525528.0,0.0 | ||
| 9 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.15,0.05,0.275,1.0,280.0,,1566.0093335900456,1565.9761460265145,1566.0093335900456,11.801395448856056,6751091800.0,938.575 | 9 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.15,0.05,0.275,1.0,280.0,,1566.0093335900456,1565.9761460265145,1566.0093335900456,11.801395448856056,6751091800.0,6751091800.0,938.575 | ||
| 10 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.95,0.875,1.0,1.0,1304.5,,1995.8721044822596,1995.802208490204,1995.8721044822596,12.078374973498285,7123374444.0,0.0 | 10 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.95,0.875,1.0,1.0,1304.5,,1995.8721044822596,1995.802208490204,1995.8721044822596,12.078374973498285,7123374444.0,7123374444.0,0.0 | ||
| 11 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0,0.0,0.0,0.0,,,0.0,0.0,0.0,,,0.0 | 11 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0,0.0,0.0,0.0,,,0.0,0.0,0.0,,,,0.0 | ||
| 12 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.95,0.875,1.0,1.0,209433294.0,209420288.0,2161.7709995480254,1476.9027290167287,2161.7709995480254,51.358687051106244,7181169892.0,0.0 | 12 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.95,0.875,1.0,1.0,209433294.0,209420288.0,2161.7709995480254,1476.9027290167287,2161.7709995480254,51.358687051106244,7181169892.0,7181169892.0,0.0 | ||
| 13 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.95,0.875,1.0,1.0,209433322.0,209420288.0,2183.0639789113775,1496.8550420016982,2183.0639789113775,49.82733295764774,7180973284.0,0.0 | 13 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.95,0.875,1.0,1.0,209433322.0,209420288.0,2183.0639789113775,1496.8550420016982,2183.0639789113775,49.82733295764774,7180973284.0,7180973284.0,0.0 | ||
| 14 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,1.0,1.0,1.0,1.0,58926513.0,58899456.0,2119.401790900156,1451.94422948407,2119.401790900156,42.334249475970864,6889044124.0,0.0 | 14 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,1.0,1.0,1.0,1.0,58926513.0,58899456.0,2119.401790900156,1451.94422948407,2119.401790900156,42.334249475970864,6889044124.0,7112184172.0,0.0 | ||
| 15 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.975,0.925,1.0,1.0,111281646.0,111254528.0,2210.5782500002533,1535.811958485283,2210.5782500002533,46.82985402178019,6988483448.0,0.0 | 15 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.975,0.925,1.0,1.0,111281646.0,111254528.0,2210.5782500002533,1535.811958485283,2210.5782500002533,46.82985402178019,6988483448.0,7112184172.0,0.0 | ||
| 16 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.0,0.0,0.0,1.0,52310610.5,52297728.0,1860.3221669909544,1205.5079169222154,1860.3221669909544,38.808708486612886,6849066220.0,0.0 | 16 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.0,0.0,0.0,1.0,52310610.5,52297728.0,1860.3221669909544,1205.5079169222154,1860.3221669909544,38.808708486612886,6849066220.0,7112184172.0,0.0 | ||
| 17 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,1.0,52310605.5,52297728.0,4451.304083515424,3796.235208399594,4451.304083515424,38.95141644170508,6849033452.0,0.0 | 17 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,1.0,52310605.5,52297728.0,4451.304083515424,3796.235208399594,4451.304083515424,38.95141644170508,6849033452.0,7112184172.0,0.0 | ||
| 18 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.0,0.0,0.0,1.0,52310650.0,52297728.0,1806.6551666124724,1050.931437057443,1806.6551666124724,38.52089599240571,6849033452.0,0.0 | 18 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.0,0.0,0.0,1.0,52310650.0,52297728.0,1806.6551666124724,1050.931437057443,1806.6551666124724,38.52089599240571,6849033452.0,7112184172.0,0.0 | ||
| 19 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.0,0.0,0.0,1.0,52310650.5,52297728.0,3011.4672069321387,2129.6908954391256,3011.4672069321387,38.901541964150965,6849033452.0,0.0 | 19 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.0,0.0,0.0,1.0,52310650.5,52297728.0,3011.4672069321387,2129.6908954391256,3011.4672069321387,38.901541964150965,6849033452.0,7112184172.0,0.0 | ||
| 20 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.0,0.0,0.0,1.0,52310620.5,52297728.0,2778.506062924862,2027.1265839692205,2778.506062924862,334.88885447150096,6845531164.0,0.0 | 20 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.0,0.0,0.0,1.0,52310620.5,52297728.0,2778.506062924862,2027.1265839692205,2778.506062924862,334.88885447150096,6845531164.0,7112184172.0,0.0 | ||
| 21 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.0,0.0,0.0,1.0,27809951.5,27783168.0,1970.285561925266,1212.8924999851733,1970.285561925266,38.66083355387673,6801847812.0,0.0 | 21 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.0,0.0,0.0,1.0,27809951.5,27783168.0,1970.285561925266,1212.8924999851733,1970.285561925266,38.66083355387673,6801847812.0,7112184172.0,0.0 | ||
| 22 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.0,0.0,0.0,1.0,0.0,,50.99683249136433,50.98568700486794,50.99683249136433,13.265458575915545,6245933480.0,0.0 | 22 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.0,0.0,0.0,1.0,0.0,,50.99683249136433,50.98568700486794,50.99683249136433,13.265458575915545,6245933480.0,6245933480.0,0.0 | ||
| 23 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,1.0,1.0,1.0,1.0,7817.0,,1616.299791377969,1616.291937418282,1616.299791377969,13.873937481548637,7018315388.0,0.0 | 23 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,1.0,1.0,1.0,1.0,7817.0,,1616.299791377969,1616.291937418282,1616.299791377969,13.873937481548637,7018315388.0,7018315388.0,0.0 | ||
| 24 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,1.0,1.0,1.0,1.0,2063.0,,1380.298041505739,1378.6934584495611,1380.298041505739,13.52102094097063,6569209944.0,0.0 | 24 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,1.0,1.0,1.0,1.0,2063.0,,1380.298041505739,1378.6934584495611,1380.298041505739,13.52102094097063,6569209944.0,6569209944.0,0.0 | ||
| 25 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.5,0.35,0.65,1.0,2308.5,,1505.1244788919576,1503.8990624598227,1505.1244788919576,13.473541475832462,6562050136.0,0.0 | 25 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.5,0.35,0.65,1.0,2308.5,,1505.1244788919576,1503.8990624598227,1505.1244788919576,13.473541475832462,6562050136.0,6562050136.0,0.0 | ||
| 26 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,1.0,1.0,1.0,1.0,1459.0,,1277.185709157493,1275.6410425063223,1277.185709157493,13.463333540130407,6563229784.0,0.0 | 26 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,1.0,1.0,1.0,1.0,1459.0,,1277.185709157493,1275.6410425063223,1277.185709157493,13.463333540130407,6563229784.0,6563229784.0,0.0 | ||
| 27 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.375,0.225,0.525,1.0,1329.0,,6299.70408254303,1357.3949374840595,6299.70408254303,13.420354051049799,6489106190.0,0.0 | 27 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.375,0.225,0.525,1.0,1329.0,,6299.70408254303,1357.3949374840595,6299.70408254303,13.420354051049799,6489106190.0,6489106190.0,0.0 | ||
| 28 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.125,0.025,0.225,1.0,938.0,,6534.907438093796,1300.7948960876092,6534.907438093796,13.370978937018663,6482995136.0,0.0 | 28 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.125,0.025,0.225,1.0,938.0,,6534.907438093796,1300.7948960876092,6534.907438093796,13.370978937018663,6482995136.0,6482995136.0,0.0 | ||
| 29 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.225,0.1,0.35,1.0,340.0,,1280.8366029639728,1280.813749472145,1280.8366029639728,13.503895956091583,6565030904.0,958.725 | 29 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.225,0.1,0.35,1.0,340.0,,1280.8366029639728,1280.813749472145,1280.8366029639728,13.503895956091583,6565030904.0,6565030904.0,958.725 | ||
| 30 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,1.0,1.0,1.0,1.0,1304.5,,1614.060938009061,1613.9931670040824,1614.060938009061,13.793000020086765,7018315388.0,0.0 | 30 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,1.0,1.0,1.0,1.0,1304.5,,1614.060938009061,1613.9931670040824,1614.060938009061,13.793000020086765,7018315388.0,7018315388.0,0.0 | ||
| 31 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0,0.0,0.0,1.0,2257.5,,299.0590829285793,104.2349580093287,299.0590829285793,13.515916944015771,6612414552.0,0.0 | 31 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0,0.0,0.0,1.0,2257.5,,299.0590829285793,104.2349580093287,299.0590829285793,13.515916944015771,6612414552.0,6612414552.0,0.0 | ||
| 32 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,1.0,1.0,1.0,1.0,69762760.0,69746688.0,1671.5779785299674,1454.5991040067747,1671.5779785299674,26.289125031325966,6443884896.0,0.0 | 32 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,1.0,1.0,1.0,1.0,69762760.0,69746688.0,1671.5779785299674,1454.5991040067747,1671.5779785299674,26.289125031325966,6443884896.0,7001595516.0,0.0 | ||
| 33 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,1.0,1.0,1.0,1.0,69762788.0,69746688.0,1678.0685833655298,1461.9321874342859,1678.0685833655298,26.193187979515642,6443491568.0,0.0 | 33 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,1.0,1.0,1.0,1.0,69762788.0,69746688.0,1678.0685833655298,1461.9321874342859,1678.0685833655298,26.193187979515642,6443491568.0,7001595516.0,0.0 | ||
| 34 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.0,0.0,0.0,0.825,19650296.0,19616256.0,3499.5465414831415,3281.653458427172,3499.5465414831415,20.649228943511844,6353736674.0,0.0 | 34 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.0,0.0,0.0,0.825,19650296.0,19616256.0,3499.5465414831415,3281.653458427172,3499.5465414831415,20.649228943511844,6353736674.0,7001595516.0,0.0 | ||
| 35 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,1.0,1.0,1.0,1.0,37087110.0,37052928.0,1748.5522304777987,1527.8222084743902,1748.5522304777987,20.812437462154776,6391963660.0,0.0 | 35 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,1.0,1.0,1.0,1.0,37087110.0,37052928.0,1748.5522304777987,1527.8222084743902,1748.5522304777987,20.812437462154776,6391963660.0,7001595516.0,0.0 | ||
| 36 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.0,0.0,0.0,1.0,17452581.0,17436672.0,956.3981250976212,740.5964171048254,956.3981250976212,18.599771021399647,6328893680.0,0.0 | 36 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.0,0.0,0.0,1.0,17452581.0,17436672.0,956.3981250976212,740.5964171048254,956.3981250976212,18.599771021399647,6328893680.0,7001595516.0,0.0 | ||
| 37 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,0.925,17452576.0,17436672.0,4534.33343739016,4322.83162540989,4534.33343739016,18.42766656773165,6328885488.0,0.0 | 37 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,0.925,17452576.0,17436672.0,4534.33343739016,4322.83162540989,4534.33343739016,18.42766656773165,6328885488.0,7001595516.0,0.0 | ||
| 38 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.0,0.0,0.0,1.0,17452621.0,17436672.0,1546.2896669632755,1297.9612504132092,1546.2896669632755,18.14260403625667,6328705264.0,0.0 | 38 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.0,0.0,0.0,1.0,17452621.0,17436672.0,1546.2896669632755,1297.9612504132092,1546.2896669632755,18.14260403625667,6328705264.0,7001595516.0,0.0 | ||
| 39 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.0,0.0,0.0,1.0,17452621.0,17436672.0,1404.5618129894137,1157.1117919520475,1404.5618129894137,18.43020849628374,6328705264.0,0.0 | 39 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.0,0.0,0.0,1.0,17452621.0,17436672.0,1404.5618129894137,1157.1117919520475,1404.5618129894137,18.43020849628374,6328705264.0,7001595516.0,0.0 | ||
| 40 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.0,0.0,0.0,1.0,17452580.0,17436672.0,1730.0592699903063,1481.2797500635497,1730.0592699903063,417.85912500927225,6313638200.0,0.0 | 40 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.0,0.0,0.0,1.0,17452580.0,17436672.0,1730.0592699903063,1481.2797500635497,1730.0592699903063,417.85912500927225,6313638200.0,7001595516.0,0.0 | ||
| 41 | −exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.0,0.0,0.0,1.0,9296753.0,9263232.0,1668.3023320510983,1411.4823329728097,1668.3023320510983,17.84149999730289,6317180536.0,0.0 | 41 | +exec,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.0,0.0,0.0,1.0,9296753.0,9263232.0,1668.3023320510983,1411.4823329728097,1668.3023320510983,17.84149999730289,6317180536.0,7001595516.0,0.0 | ||
| 42 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.0625,0.0,0.1375,1.0,0.0,,61.31758342962712,61.30829197354615,61.31758342962712,13.563938031438738,6515504582.0,0.0 | 42 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.0625,0.0,0.1375,1.0,0.0,,61.31758342962712,61.30829197354615,61.31758342962712,13.563938031438738,6515504582.0,6515504582.0,0.0 | ||
| 43 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,26477.0,,838.0565835395828,838.0487085087225,838.0565835395828,15.187958488240838,7614567478.0,0.0 | 43 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,26477.0,,838.0565835395828,838.0487085087225,838.0565835395828,15.187958488240838,7614567478.0,7614567478.0,0.0 | ||
| 44 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.07291666666666666,0.00625,0.15416666666666665,1.0,2053.5,,110.34681159071624,105.7645000400953,110.34681159071624,13.786938041448593,6870195718.0,0.0 | 44 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.07291666666666666,0.00625,0.15416666666666665,1.0,2053.5,,110.34681159071624,105.7645000400953,110.34681159071624,13.786938041448593,6870195718.0,6870195718.0,0.0 | ||
| 45 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.16464285714285715,0.07177678571428574,0.27214285714285713,1.0,2089.0,,120.70233299164101,118.07974940165877,120.70233299164101,13.71116645168513,6860832264.0,0.0 | 45 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.16464285714285715,0.07177678571428574,0.27214285714285713,1.0,2089.0,,120.70233299164101,118.07974940165877,120.70233299164101,13.71116645168513,6860832264.0,6860832264.0,0.0 | ||
| 46 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.034999999999999996,0.0,0.1,1.0,1924.0,,117.97743756324053,104.87143753562123,117.97743756324053,13.734270993154496,6862609914.0,0.0 | 46 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.034999999999999996,0.0,0.1,1.0,1924.0,,117.97743756324053,104.87143753562123,117.97743756324053,13.734270993154496,6862609914.0,6862609914.0,0.0 | ||
| 47 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.16297619047619047,0.06583333333333334,0.26882142857142854,1.0,2038.5,,8716.081208491232,107.33179206727073,8716.081208491232,13.712061976548284,6870957596.0,0.0 | 47 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.16297619047619047,0.06583333333333334,0.26882142857142854,1.0,2038.5,,8716.081208491232,107.33179206727073,8716.081208491232,13.712061976548284,6870957596.0,6870957596.0,0.0 | ||
| 48 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.058333333333333334,0.0,0.13333333333333336,1.0,1099.0,,8670.968083490152,84.7092714975588,8670.968083490152,13.663416961207986,6747823192.0,0.0 | 48 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.058333333333333334,0.0,0.13333333333333336,1.0,1099.0,,8670.968083490152,84.7092714975588,8670.968083490152,13.663416961207986,6747823192.0,6747823192.0,0.0 | ||
| 49 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.09880952380952382,0.023809523809523808,0.19166666666666665,1.0,389.0,,104.96470803627744,104.93379150284454,104.96470803627744,13.659229502081871,6842465788.0,923.775 | 49 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.09880952380952382,0.023809523809523808,0.19166666666666665,1.0,389.0,,104.96470803627744,104.93379150284454,104.96470803627744,13.659229502081871,6842465788.0,6842465788.0,923.775 | ||
| 50 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,10766.5,,847.1706879790872,847.0414169714786,847.1706879790872,15.424749522935599,7614567478.0,0.0 | 50 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,10766.5,,847.1706879790872,847.0414169714786,847.1706879790872,15.424749522935599,7614567478.0,7614567478.0,0.0 | ||
| 51 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.075,0.0,0.175,1.0,1816.5,,961.6785630350932,121.2931249756366,961.6785630350932,13.804020476527512,6904430324.0,0.0 | 51 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.075,0.0,0.175,1.0,1816.5,,961.6785630350932,121.2931249756366,961.6785630350932,13.804020476527512,6904430324.0,6904430324.0,0.0 | ||
| 52 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,744108792.0,744095744.0,1022.4113956210203,110.78031297074631,1022.4113956210203,42.49874997185543,8844096712.0,0.0 | 52 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,744108792.0,744095744.0,1022.4113956210203,110.78031297074631,1022.4113956210203,42.49874997185543,8844096712.0,8844096712.0,0.0 | ||
| 53 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,744108820.0,744095744.0,1078.9334585424513,177.0352924359031,1078.9334585424513,41.77858354523778,8844096712.0,0.0 | 53 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,744108820.0,744095744.0,1078.9334585424513,177.0352924359031,1078.9334585424513,41.77858354523778,8844096712.0,8844096712.0,0.0 | ||
| 54 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.21666666666666665,0.10416666666666666,0.3416666666666667,1.0,209304201.0,209276928.0,917.6457915455103,87.52035396173596,917.6457915455103,28.353708039503545,7763563872.0,0.0 | 54 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.21666666666666665,0.10416666666666666,0.3416666666666667,1.0,209304201.0,209276928.0,917.6457915455103,87.52035396173596,917.6457915455103,28.353708039503545,7763563872.0,7763563872.0,0.0 | ||
| 55 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,395328218.0,395300864.0,951.9116040901281,87.27945800637826,951.9116040901281,29.329562501516193,8176473440.0,0.0 | 55 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.3302579365079365,0.19761160714285717,0.4666666666666666,1.0,395328218.0,395300864.0,951.9116040901281,87.27945800637826,951.9116040901281,29.329562501516193,8176473440.0,8176473440.0,0.0 | ||
| 56 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.32400793650793647,0.19205357142857146,0.45912698412698416,1.0,186037056.0,186023936.0,911.9993314961903,91.53133415384218,911.9993314961903,23.624812019988894,7610430656.0,0.0 | 56 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.32400793650793647,0.19205357142857146,0.45912698412698416,1.0,186037056.0,186023936.0,911.9993314961903,91.53133415384218,911.9993314961903,23.624812019988894,7610430656.0,7638209748.0,0.0 | ||
| 57 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,0.825,186037051.0,186023936.0,1403.2247085124254,712.2888540616259,1403.2247085124254,23.287000018171966,7610430656.0,0.0 | 57 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.0,0.0,0.0,0.825,186037051.0,186023936.0,1403.2247085124254,712.2888540616259,1403.2247085124254,23.287000018171966,7610430656.0,7638209748.0,0.0 | ||
| 58 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.32089285714285715,0.1875,0.4596651785714284,1.0,186037096.0,186023936.0,990.1295835734345,69.1054585040547,990.1295835734345,22.277812531683594,7610430656.0,0.0 | 58 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.32089285714285715,0.1875,0.4596651785714284,1.0,186037096.0,186023936.0,990.1295835734345,69.1054585040547,990.1295835734345,22.277812531683594,7610430656.0,7638209748.0,0.0 | ||
| 59 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.2838888888888889,0.15888194444444448,0.42056249999999995,1.0,186037096.0,186023936.0,959.1962915146723,64.08647989155725,959.1962915146723,22.64814602676779,7610430656.0,0.0 | 59 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.2838888888888889,0.15888194444444448,0.42056249999999995,1.0,186037096.0,186023936.0,959.1962915146723,64.08647989155725,959.1962915146723,22.64814602676779,7610430656.0,7638209748.0,0.0 | ||
| 60 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.29375,0.15625,0.4375,1.0,186037011.0,186023936.0,1427.9097704566084,526.5463123796508,1427.9097704566084,493.36456251330674,7803809312.0,0.0 | 60 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.29375,0.15625,0.4375,1.0,186037011.0,186023936.0,1427.9097704566084,526.5463123796508,1427.9097704566084,493.36456251330674,7803809312.0,7803809312.0,0.0 | ||
| 61 | −public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.32089285714285715,0.1875,0.4596651785714284,1.0,98852491.0,98825216.0,976.0725206579082,70.43647894170135,976.0725206579082,19.95449955575168,7458923884.0,0.0 | 61 | +public_2wikimqa,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.32089285714285715,0.1875,0.4596651785714284,1.0,98852491.0,98825216.0,976.0725206579082,70.43647894170135,976.0725206579082,19.95449955575168,7458923884.0,7607489594.0,0.0 | ||
| 62 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.1125,0.0375,0.2125,1.0,0.0,,59.17302001034841,59.158478514291346,59.17302001034841,13.196521031204611,6241993108.0,0.0 | 62 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.1125,0.0375,0.2125,1.0,0.0,,59.17302001034841,59.158478514291346,59.17302001034841,13.196521031204611,6241993108.0,6241993108.0,0.0 | ||
| 63 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,0.3875,0.25,0.5375,1.0,26477.0,,862.7995005808771,862.7924170577899,862.7995005808771,14.084312540944666,7239368768.0,0.0 | 63 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,0.3875,0.25,0.5375,1.0,26477.0,,862.7995005808771,862.7924170577899,862.7995005808771,14.084312540944666,7239368768.0,7239368768.0,0.0 | ||
| 64 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.11666666666666665,0.025,0.225,1.0,1973.0,,106.45749949617311,97.87616651738063,106.45749949617311,13.45000002766028,6568923224.0,0.0 | 64 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.11666666666666665,0.025,0.225,1.0,1973.0,,106.45749949617311,97.87616651738063,106.45749949617311,13.45000002766028,6568923224.0,6568923224.0,0.0 | ||
| 65 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.21291666666666664,0.11041666666666665,0.3300312499999998,1.0,1940.5,,113.71260363375768,110.9033121028915,113.71260363375768,13.465750496834517,6559346776.0,0.0 | 65 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.21291666666666664,0.11041666666666665,0.3300312499999998,1.0,1940.5,,113.71260363375768,110.9033121028915,113.71260363375768,13.465750496834517,6559346776.0,6559346776.0,0.0 | ||
| 66 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.1125,0.025,0.2125,1.0,1735.0,,114.57770806737244,96.89510404132307,114.57770806737244,13.402666547335684,6562443352.0,0.0 | 66 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.1125,0.025,0.2125,1.0,1735.0,,114.57770806737244,96.89510404132307,114.57770806737244,13.402666547335684,6562443352.0,6562443352.0,0.0 | ||
| 67 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.20347222222222222,0.09791666666666667,0.3208506944444443,1.0,1749.5,,8053.586145979352,97.53939497750252,8053.586145979352,13.36843753233552,6583652440.0,0.0 | 67 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.20347222222222222,0.09791666666666667,0.3208506944444443,1.0,1749.5,,8053.586145979352,97.53939497750252,8053.586145979352,13.36843753233552,6583652440.0,6583652440.0,0.0 | ||
| 68 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.12333333333333334,0.04,0.23166666666666663,1.0,810.0,,7940.129436494317,80.12141706421971,7940.129436494317,13.376353948842734,6494488374.0,0.0 | 68 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.12333333333333334,0.04,0.23166666666666663,1.0,810.0,,7940.129436494317,80.12141706421971,7940.129436494317,13.376353948842734,6494488374.0,6494488374.0,0.0 | ||
| 69 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.11000000000000001,0.025,0.22000000000000003,1.0,466.5,,126.47829105844721,126.43012392800301,126.47829105844721,13.430749473627657,6640562264.0,1217.275 | 69 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.11000000000000001,0.025,0.22000000000000003,1.0,466.5,,126.47829105844721,126.43012392800301,126.47829105844721,13.430749473627657,6640562264.0,6640562264.0,1217.275 | ||
| 70 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3875,0.25,0.5375,1.0,10766.5,,986.8479584692977,986.7087295278907,986.8479584692977,14.408541494049132,7239368768.0,0.0 | 70 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3875,0.25,0.5375,1.0,10766.5,,986.8479584692977,986.7087295278907,986.8479584692977,14.408541494049132,7239368768.0,7239368768.0,0.0 | ||
| 71 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0625,0.0,0.1375,1.0,1721.5,,667.4353124690242,109.33960444526747,667.4353124690242,13.598332996480167,6599094360.0,0.0 | 71 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0625,0.0,0.1375,1.0,1721.5,,667.4353124690242,109.33960444526747,667.4353124690242,13.598332996480167,6599094360.0,6599094360.0,0.0 | ||
| 72 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,254580530.0,254564352.0,1078.0544368899427,123.88258392456919,1078.0544368899427,58.98822902236134,7024730428.0,0.0 | 72 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,254580530.0,254564352.0,1078.0544368899427,123.88258392456919,1078.0544368899427,58.98822902236134,7024730428.0,7239360576.0,0.0 | ||
| 73 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,254580558.0,254564352.0,1081.1359789804555,142.88037497317418,1081.1359789804555,54.69964555231854,7024730316.0,0.0 | 73 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,254580558.0,254564352.0,1081.1359789804555,142.88037497317418,1081.1359789804555,54.69964555231854,7024730316.0,7239360576.0,0.0 | ||
| 74 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.003913630229419702,0.0,0.010458839406207825,0.975,71630478.0,71596224.0,1630.7963539729826,739.3143955268897,1630.7963539729826,29.354833532124758,6681390136.0,0.0 | 74 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.003913630229419702,0.0,0.010458839406207825,0.975,71630478.0,71596224.0,1630.7963539729826,739.3143955268897,1630.7963539729826,29.354833532124758,6681390136.0,7239360576.0,0.0 | ||
| 75 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,135271688.0,135237312.0,1035.3826249483973,97.3766659735702,1035.3826249483973,30.708041042089462,6821831068.5,0.0 | 75 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.3625,0.225,0.5041666666666667,1.0,135271688.0,135237312.0,1035.3826249483973,97.3766659735702,1035.3826249483973,30.708041042089462,6821831068.5,7239360576.0,0.0 | ||
| 76 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.39464285714285713,0.25416666666666665,0.5488392857142856,1.0,63661888.0,63645696.0,1020.8498335559852,81.72633306821808,1020.8498335559852,24.91972898133099,6605316300.0,0.0 | 76 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.39464285714285713,0.25416666666666665,0.5488392857142856,1.0,63661888.0,63645696.0,1020.8498335559852,81.72633306821808,1020.8498335559852,24.91972898133099,6605316300.0,7239360576.0,0.0 | ||
| 77 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.008613445378151261,0.0,0.024369747899159667,0.925,63661883.0,63645696.0,1539.1613344545476,676.473917614203,1539.1613344545476,24.953124986495823,6605316300.0,0.0 | 77 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.008613445378151261,0.0,0.024369747899159667,0.925,63661883.0,63645696.0,1539.1613344545476,676.473917614203,1539.1613344545476,24.953124986495823,6605316300.0,7239360576.0,0.0 | ||
| 78 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.3392857142857143,0.2,0.4833333333333333,1.0,63661928.0,63645696.0,1062.0520829688758,82.09260407602414,1062.0520829688758,24.084812554065138,6605316300.0,0.0 | 78 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.3392857142857143,0.2,0.4833333333333333,1.0,63661928.0,63645696.0,1062.0520829688758,82.09260407602414,1062.0520829688758,24.084812554065138,6605316300.0,7239360576.0,0.0 | ||
| 79 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.30625,0.175,0.45,1.0,63661928.0,63645696.0,1037.0062295696698,79.50931205414236,1037.0062295696698,24.317916948348284,6605316300.0,0.0 | 79 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.30625,0.175,0.45,1.0,63661928.0,63645696.0,1037.0062295696698,79.50931205414236,1037.0062295696698,24.317916948348284,6605316300.0,7239360576.0,0.0 | ||
| 80 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.36428571428571427,0.228482142857143,0.5083630952380951,1.0,63661830.0,63645696.0,1445.9590209880844,466.9628744595684,1445.9590209880844,398.6886665225029,6655922112.0,0.0 | 80 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.36428571428571427,0.228482142857143,0.5083630952380951,1.0,63661830.0,63645696.0,1445.9590209880844,466.9628744595684,1445.9590209880844,398.6886665225029,6655922112.0,7239360576.0,0.0 | ||
| 81 | −public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.35178571428571426,0.21845238095238093,0.4916666666666666,1.0,33846113.5,33811776.0,1065.1935209752992,79.09508352167904,1065.1935209752992,19.883000059053302,6554773592.0,0.0 | 81 | +public_2wikimqa,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.35178571428571426,0.21845238095238093,0.4916666666666666,1.0,33846113.5,33811776.0,1065.1935209752992,79.09508352167904,1065.1935209752992,19.883000059053302,6554773592.0,7239360576.0,0.0 | ||
| 82 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.053520674727571285,0.00762987012987013,0.11977830646365119,1.0,0.0,,65.9553125151433,65.94904151279479,65.9553125151433,13.496875006239861,6510474664.0,0.0 | 82 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,40,40,0.053520674727571285,0.00762987012987013,0.11977830646365119,1.0,0.0,,65.9553125151433,65.94904151279479,65.9553125151433,13.496875006239861,6510474664.0,6510474664.0,0.0 | ||
| 83 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,24485.5,,727.1668530884199,727.1603115950711,727.1668530884199,14.904125011526048,7465718848.0,0.0 | 83 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,24485.5,,727.1668530884199,727.1603115950711,727.1668530884199,14.904125011526048,7465718848.0,7465718848.0,0.0 | ||
| 84 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.06596767217456873,0.02368412239101894,0.1264588058014782,1.0,2645.0,,129.87125013023615,127.00175010832027,129.87125013023615,13.727125013247132,6865649128.0,0.0 | 84 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.06596767217456873,0.02368412239101894,0.1264588058014782,1.0,2645.0,,129.87125013023615,127.00175010832027,129.87125013023615,13.727125013247132,6865649128.0,6865649128.0,0.0 | ||
| 85 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.23695446852096466,0.14541538242944893,0.3455378195824967,1.0,2503.5,,158.11447944724932,156.55895846430212,158.11447944724932,13.684041507076472,6856752608.0,0.0 | 85 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.23695446852096466,0.14541538242944893,0.3455378195824967,1.0,2503.5,,158.11447944724932,156.55895846430212,158.11447944724932,13.684041507076472,6856752608.0,6856752608.0,0.0 | ||
| 86 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.14415518358453142,0.06653808284107197,0.22890076522209668,1.0,2108.5,,149.97426996706054,143.4077289304696,149.97426996706054,13.658125011716038,6859865572.0,0.0 | 86 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.14415518358453142,0.06653808284107197,0.22890076522209668,1.0,2108.5,,149.97426996706054,143.4077289304696,149.97426996706054,13.658125011716038,6859865572.0,6859865572.0,0.0 | ||
| 87 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.19959273932500582,0.10820102144256978,0.30105128414152005,1.0,2603.0,,8184.926540940069,143.69518699822947,8184.926540940069,13.65083345444873,6863125988.0,0.0 | 87 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.19959273932500582,0.10820102144256978,0.30105128414152005,1.0,2603.0,,8184.926540940069,143.69518699822947,8184.926540940069,13.65083345444873,6863125988.0,6863125988.0,0.0 | ||
| 88 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.05102564102564102,0.008333333333333333,0.11103311965811961,1.0,968.0,,8221.8351039337,81.11052104504779,8221.8351039337,13.581979554146528,6697516120.0,0.0 | 88 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.05102564102564102,0.008333333333333333,0.11103311965811961,1.0,968.0,,8221.8351039337,81.11052104504779,8221.8351039337,13.581979554146528,6697516120.0,6697516120.0,0.0 | ||
| 89 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.0661431623931624,0.015382211538461544,0.13314583333333332,1.0,431.0,,111.73445841995999,111.69662489555776,111.73445841995999,13.675124966539443,6877355576.0,1288.45 | 89 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.0661431623931624,0.015382211538461544,0.13314583333333332,1.0,431.0,,111.73445841995999,111.69662489555776,111.73445841995999,13.675124966539443,6877355576.0,6877355576.0,1288.45 | ||
| 90 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,9070.5,,785.8203329960816,785.5639375047758,785.8203329960816,15.055291471071541,7465718848.0,0.0 | 90 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,9070.5,,785.8203329960816,785.5639375047758,785.8203329960816,15.055291471071541,7465718848.0,7465718848.0,0.0 | ||
| 91 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.22771284244269147,0.1316498298861027,0.33295768298472694,1.0,2545.5,,770.1807499979623,150.92641697265208,770.1807499979623,13.779875007458031,6907231900.0,0.0 | 91 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.22771284244269147,0.1316498298861027,0.33295768298472694,1.0,2545.5,,770.1807499979623,150.92641697265208,770.1807499979623,13.779875007458031,6907231900.0,6907231900.0,0.0 | ||
| 92 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,578040564.0,578027520.0,966.9294175691903,141.73779159318656,966.9294175691903,38.254000479355454,8312747188.0,0.0 | 92 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,578040564.0,578027520.0,966.9294175691903,141.73779159318656,966.9294175691903,38.254000479355454,8312747188.0,8312747188.0,0.0 | ||
| 93 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,578040592.0,578027520.0,1006.8175835185684,191.32306252140552,1006.8175835185684,36.52475000126287,8312747188.0,0.0 | 93 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,578040592.0,578027520.0,1006.8175835185684,191.32306252140552,1006.8175835185684,36.52475000126287,8312747188.0,8312747188.0,0.0 | ||
| 94 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.25432579117832765,0.153750429395278,0.363530122247789,1.0,162597464.0,162570240.0,875.7963750394993,123.03260347107425,875.7963750394993,24.27243796410039,7439708640.0,0.0 | 94 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.25432579117832765,0.153750429395278,0.363530122247789,1.0,162597464.0,162570240.0,875.7963750394993,123.03260347107425,875.7963750394993,24.27243796410039,7439708640.0,7458149440.0,0.0 | ||
| 95 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,307104450.0,307077120.0,923.8226665765978,128.16997891059145,923.8226665765978,25.769770552869886,7759564508.0,0.0 | 95 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.2537783280350416,0.15373085330146563,0.36433162174894096,1.0,307104450.0,307077120.0,923.8226665765978,128.16997891059145,923.8226665765978,25.769770552869886,7759564508.0,7759564508.0,0.0 | ||
| 96 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.16082072722300209,0.08518288294532156,0.2510588201241594,1.0,144519982.5,144506880.0,827.808978559915,88.17443740554154,827.808978559915,21.28720801556483,7362794676.0,0.0 | 96 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.16082072722300209,0.08518288294532156,0.2510588201241594,1.0,144519982.5,144506880.0,827.808978559915,88.17443740554154,827.808978559915,21.28720801556483,7362794676.0,7458149440.0,0.0 | ||
| 97 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.07447303921568628,0.011764705882352943,0.159375,0.85,144519977.0,144506880.0,1270.7714784191921,697.6080205058679,1270.7714784191921,20.92524996260181,7362794676.0,0.0 | 97 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.07447303921568628,0.011764705882352943,0.159375,0.85,144519977.0,144506880.0,1270.7714784191921,697.6080205058679,1270.7714784191921,20.92524996260181,7362794676.0,7458149440.0,0.0 | ||
| 98 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.24277583985218615,0.151606606366538,0.34430225224520655,1.0,144520021.0,144506880.0,904.3003126280382,109.62083359481767,904.3003126280382,20.468145434278995,7362794676.0,0.0 | 98 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.24277583985218615,0.151606606366538,0.34430225224520655,1.0,144520021.0,144506880.0,904.3003126280382,109.62083359481767,904.3003126280382,20.468145434278995,7362794676.0,7458149440.0,0.0 | ||
| 99 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.1870317755238296,0.09726531188192125,0.28550238619193186,1.0,144520022.0,144506880.0,885.7176880119368,82.61193748330697,885.7176880119368,20.840229000896215,7362794676.0,0.0 | 99 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.1870317755238296,0.09726531188192125,0.28550238619193186,1.0,144520022.0,144506880.0,885.7176880119368,82.61193748330697,885.7176880119368,20.840229000896215,7362794676.0,7458149440.0,0.0 | ||
| 100 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.243191089563836,0.1529984118743194,0.34138962849027604,1.0,144519925.0,144506880.0,1196.1688324809074,467.6350621157326,1196.1688324809074,337.63170801103115,7496383140.0,0.0 | 100 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.243191089563836,0.1529984118743194,0.34138962849027604,1.0,144519925.0,144506880.0,1196.1688324809074,467.6350621157326,1196.1688324809074,337.63170801103115,7496383140.0,7496383140.0,0.0 | ||
| 101 | −public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.23538707665459943,0.1437460416846976,0.33762197165669905,1.0,76796546.0,76769280.0,894.2440829705447,95.0739789986983,894.2440829705447,19.250125042162836,7227740640.0,0.0 | 101 | +public_qasper,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.23538707665459943,0.1437460416846976,0.33762197165669905,1.0,76796546.0,76769280.0,894.2440829705447,95.0739789986983,894.2440829705447,19.250125042162836,7227740640.0,7458149440.0,0.0 | ||
| 102 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.04142585580594076,0.007637997532383382,0.09814090546216682,1.0,0.0,,46.06579209212214,46.056688064709306,46.06579209212214,13.382770994212478,6219424104.0,0.0 | 102 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,40,40,0.04142585580594076,0.007637997532383382,0.09814090546216682,1.0,0.0,,46.06579209212214,46.056688064709306,46.06579209212214,13.382770994212478,6219424104.0,6219424104.0,0.0 | ||
| 103 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,0.3524582923320977,0.23883181230104608,0.47279664560678997,1.0,24485.5,,745.9065829752944,745.8995829802006,745.9065829752944,14.21087549533695,7155474496.0,0.0 | 103 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,40,40,0.3524582923320977,0.23883181230104608,0.47279664560678997,1.0,24485.5,,745.9065829752944,745.8995829802006,745.9065829752944,14.21087549533695,7155474496.0,7155474496.0,0.0 | ||
| 104 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.0878869286287089,0.028754152823920263,0.16423767995570318,1.0,2601.5,,108.99041715310887,103.18029159680009,108.99041715310887,13.605854008346796,6564311128.0,0.0 | 104 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,40,40,0.0878869286287089,0.028754152823920263,0.16423767995570318,1.0,2601.5,,108.99041715310887,103.18029159680009,108.99041715310887,13.605854008346796,6564311128.0,6564311128.0,0.0 | ||
| 105 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.20037559549133369,0.11038688582962186,0.29392695953636033,1.0,2489.0,,121.99314642930403,120.10777142131701,121.99314642930403,13.487062067724764,6556938328.0,0.0 | 105 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,40,40,0.20037559549133369,0.11038688582962186,0.29392695953636033,1.0,2489.0,,121.99314642930403,120.10777142131701,121.99314642930403,13.487062067724764,6556938328.0,6556938328.0,0.0 | ||
| 106 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.17671057593077716,0.08363678728070176,0.28627020446336426,1.0,1921.5,,125.1891881111078,115.41158257750794,125.1891881111078,13.500208500772715,6557331544.0,0.0 | 106 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,40,40,0.17671057593077716,0.08363678728070176,0.28627020446336426,1.0,1921.5,,125.1891881111078,115.41158257750794,125.1891881111078,13.500208500772715,6557331544.0,6557331544.0,0.0 | ||
| 107 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.1712858923966609,0.08545177548376676,0.27294349495381276,1.0,1576.5,,5029.291937593371,83.08352145832032,5029.291937593371,13.349354558158666,6488081952.0,0.0 | 107 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,40,40,0.1712858923966609,0.08545177548376676,0.27294349495381276,1.0,1576.5,,5029.291937593371,83.08352145832032,5029.291937593371,13.349354558158666,6488081952.0,6488081952.0,0.0 | ||
| 108 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.09325396825396826,0.025,0.18214285714285713,1.0,864.5,,7716.917958576232,75.53093699971214,7716.917958576232,13.376458489801735,6465111492.0,0.0 | 108 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.09325396825396826,0.025,0.18214285714285713,1.0,864.5,,7716.917958576232,75.53093699971214,7716.917958576232,13.376458489801735,6465111492.0,6465111492.0,0.0 | ||
| 109 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.0916328761677599,0.024966209501093222,0.17325129198966407,1.0,402.0,,102.26277098990977,102.22927096765488,102.26277098990977,13.375187467318028,6580244568.0,1275.675 | 109 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.0916328761677599,0.024966209501093222,0.17325129198966407,1.0,402.0,,102.26277098990977,102.22927096765488,102.26277098990977,13.375187467318028,6580244568.0,6580244568.0,1275.675 | ||
| 110 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3524582923320977,0.23883181230104608,0.47279664560678997,1.0,9070.5,,764.1158540500328,763.9933960163034,764.1158540500328,14.18656250461936,7155474496.0,0.0 | 110 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.3524582923320977,0.23883181230104608,0.47279664560678997,1.0,9070.5,,764.1158540500328,763.9933960163034,764.1158540500328,14.18656250461936,7155474496.0,7155474496.0,0.0 | ||
| 111 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.1703928482427472,0.095372260168256,0.2543030919048409,1.0,2485.5,,584.9466664367355,130.6202500127256,584.9466664367355,13.61447898671031,6607204440.0,0.0 | 111 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.1703928482427472,0.095372260168256,0.2543030919048409,1.0,2485.5,,584.9466664367355,130.6202500127256,584.9466664367355,13.61447898671031,6607204440.0,6607204440.0,0.0 | ||
| 112 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,0.352023064477515,0.2383965844464634,0.4719260368517915,1.0,189331228.0,189315072.0,868.3839794830419,136.56529149739072,868.3839794830419,45.000125479418784,6814936304.0,0.0 | 112 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,40,40,0.352023064477515,0.2383965844464634,0.4719260368517915,1.0,189331228.0,189315072.0,868.3839794830419,136.56529149739072,868.3839794830419,45.000125479418784,6814936304.0,7155474496.0,0.0 | ||
| 113 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,0.352023064477515,0.2383965844464634,0.4719260368517915,1.0,189331256.0,189315072.0,887.9102920764126,149.75345897255465,887.9102920764126,42.2816455247812,6814936248.0,0.0 | 113 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,40,40,0.352023064477515,0.2383965844464634,0.4719260368517915,1.0,189331256.0,189315072.0,887.9102920764126,149.75345897255465,887.9102920764126,42.2816455247812,6814936248.0,7155474496.0,0.0 | ||
| 114 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.006331743508214097,0.0,0.015313487016428186,0.85,53279094.0,53244864.0,1377.5208949227817,727.0087914657779,1377.5208949227817,23.64412450697273,6560093950.5,0.0 | 114 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,0.006331743508214097,0.0,0.015313487016428186,0.85,53279094.0,53244864.0,1377.5208949227817,727.0087914657779,1377.5208949227817,23.64412450697273,6560093950.5,7155474496.0,0.0 | ||
| 115 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.37503821241201774,0.2544268509119095,0.503267557517078,1.0,100607913.0,100573632.0,852.9593333369121,107.36995853949338,852.9593333369121,24.1553335217759,6662213424.0,0.0 | 115 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,40,40,0.37503821241201774,0.2544268509119095,0.503267557517078,1.0,100607913.0,100573632.0,852.9593333369121,107.36995853949338,852.9593333369121,24.1553335217759,6662213424.0,7155474496.0,0.0 | ||
| 116 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.18833570671908945,0.09931079256446874,0.29042796386027525,1.0,47349560.0,47333376.0,816.352813562844,73.56977043673396,816.352813562844,22.071291517931968,6504754360.0,0.0 | 116 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,40,40,0.18833570671908945,0.09931079256446874,0.29042796386027525,1.0,47349560.0,47333376.0,816.352813562844,73.56977043673396,816.352813562844,22.071291517931968,6504754360.0,7155474496.0,0.0 | ||
| 117 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.06238475229321912,0.015609953325342348,0.13097708649410586,0.9,47349555.0,47333376.0,1191.2303749704733,497.9330000351183,1191.2303749704733,22.010812477674335,6504754360.0,0.0 | 117 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,40,40,0.06238475229321912,0.015609953325342348,0.13097708649410586,0.9,47349555.0,47333376.0,1191.2303749704733,497.9330000351183,1191.2303749704733,22.010812477674335,6504754360.0,7155474496.0,0.0 | ||
| 118 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.2865065059897759,0.18546910413002085,0.40048248270099884,1.0,47349600.0,47333376.0,856.4752705860883,91.3222705712542,856.4752705860883,21.61108300788328,6504328376.0,0.0 | 118 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,40,40,0.2865065059897759,0.18546910413002085,0.40048248270099884,1.0,47349600.0,47333376.0,856.4752705860883,91.3222705712542,856.4752705860883,21.61108300788328,6504328376.0,7155474496.0,0.0 | ||
| 119 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.20624202311879092,0.1117775040316477,0.3167712243764782,1.0,47349600.0,47333376.0,849.5922079309821,62.9603749839589,849.5922079309821,21.98331250110641,6504328376.0,0.0 | 119 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,40,40,0.20624202311879092,0.1117775040316477,0.3167712243764782,1.0,47349600.0,47333376.0,849.5922079309821,62.9603749839589,849.5922079309821,21.98331250110641,6504328376.0,7155474496.0,0.0 | ||
| 120 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.2652581506721279,0.16187616797075396,0.38009561979821493,1.0,47349474.0,47333376.0,1156.025978445541,388.32566648488864,1156.025978445541,306.9419994717464,6541476740.0,0.0 | 120 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,40,40,0.2652581506721279,0.16187616797075396,0.38009561979821493,1.0,47349474.0,47333376.0,1156.025978445541,388.32566648488864,1156.025978445541,306.9419994717464,6541476740.0,7155474496.0,0.0 | ||
| 121 | −public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.2844661026716981,0.18117210682811177,0.4016838943872298,1.0,25180151.5,25145856.0,865.985604992602,93.56572898104787,865.985604992602,19.180521019734442,6464650960.0,0.0 | 121 | +public_qasper,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,40,40,0.2844661026716981,0.18117210682811177,0.4016838943872298,1.0,25180151.5,25145856.0,865.985604992602,93.56572898104787,865.985604992602,19.180521019734442,6464650960.0,7155474496.0,0.0 | ||
| 122 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,200,40,0.0,0.0,0.0,1.0,0.0,,157.36941754585132,157.36408397788182,157.36515069147572,23.465062549803406,6555547060.0,0.0 | 122 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,200,40,0.0,0.0,0.0,1.0,0.0,,157.36941754585132,157.36408397788182,157.36515069147572,23.465062549803406,6555547060.0,6555547060.0,0.0 | ||
| 123 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,200,40,0.99,0.975,1.0,1.0,29207.5,,2861.687187454663,2861.679062480107,2861.680687475018,27.46989601291716,7576794164.0,0.0 | 123 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,200,40,0.99,0.975,1.0,1.0,29207.5,,2861.687187454663,2861.679062480107,2861.680687475018,27.46989601291716,7576794164.0,7576794164.0,0.0 | ||
| 124 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,200,40,0.205,0.17,0.24,1.0,2347.0,,405.87554196827114,402.4369170074351,402.91585446102545,26.229520968627185,6810402320.0,0.0 | 124 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,200,40,0.205,0.17,0.24,1.0,2347.0,,405.87554196827114,402.4369170074351,402.91585446102545,26.229520968627185,6810402320.0,6810402320.0,0.0 | ||
| 125 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,200,40,0.995,0.985,1.0,1.0,1604.5,,532.9524165135808,530.521520995535,532.9524165135808,24.227604502812028,6806912504.0,0.0 | 125 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,200,40,0.995,0.985,1.0,1.0,1604.5,,532.9524165135808,530.521520995535,532.9524165135808,24.227604502812028,6806912504.0,6806912504.0,0.0 | ||
| 126 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,200,40,0.405,0.4,0.415,1.0,1563.5,,444.42235393216833,436.8094165693037,438.5126998764463,24.473979545291513,6803176952.0,0.0 | 126 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,200,40,0.405,0.4,0.415,1.0,1563.5,,444.42235393216833,436.8094165693037,438.5126998764463,24.473979545291513,6803176952.0,6803176952.0,0.0 | ||
| 127 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|aware,A4,aware,120,40,0.8333333333333334,0.7666666666666667,0.9,1.0,1509.0,,18769.84793745214,520.637666573748,18769.84793745214,25.514833512715995,6817431036.0,0.0 | 127 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|aware,A4,aware,120,40,0.8333333333333334,0.7666666666666667,0.9,1.0,1509.0,,18769.84793745214,520.637666573748,18769.84793745214,25.514833512715995,6817431036.0,6817431036.0,0.0 | ||
| 128 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,200,40,0.44,0.385,0.495,1.0,1838.5,,18976.632187899668,444.4485829444602,4166.054411872756,25.369146023876965,6817431036.0,0.0 | 128 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,200,40,0.44,0.385,0.495,1.0,1838.5,,18976.632187899668,444.4485829444602,4166.054411872756,25.369146023876965,6817431036.0,6817431036.0,0.0 | ||
| 129 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|aware,A5,aware,120,40,0.95,0.9083333333333333,0.9833333333333333,1.0,233.5,,8669.620249595027,422.92658297810704,8669.620249595027,26.59820852568373,6607812288.0,0.0 | 129 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|aware,A5,aware,120,40,0.95,0.9083333333333333,0.9833333333333333,1.0,233.5,,8669.620249595027,422.92658297810704,8669.620249595027,26.59820852568373,6607812288.0,6607812288.0,0.0 | ||
| 130 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,200,40,0.125,0.09,0.155,1.0,842.0,,18998.95481200656,344.1750835045241,4091.6990083642304,23.827395518310368,6734748760.0,0.0 | 130 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,200,40,0.125,0.09,0.155,1.0,842.0,,18998.95481200656,344.1750835045241,4091.6990083642304,23.827395518310368,6734748760.0,6734748760.0,0.0 | ||
| 131 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,200,40,0.175,0.135,0.215,1.0,707.0,,492.9024174925871,492.8722715121694,492.87830070825294,25.794854445848614,6933195852.0,1367.27 | 131 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,200,40,0.175,0.135,0.215,1.0,707.0,,492.9024174925871,492.8722715121694,492.87830070825294,25.794854445848614,6933195852.0,6933195852.0,1367.27 | ||
| 132 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,200,40,0.99,0.975,1.0,1.0,2726.0,,2857.3816449497826,2857.2952494141646,2857.312528521288,27.074062498286366,7576794164.0,0.0 | 132 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,200,40,0.99,0.975,1.0,1.0,2726.0,,2857.3816449497826,2857.2952494141646,2857.312528521288,27.074062498286366,7576794164.0,7576794164.0,0.0 | ||
| 133 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,200,40,0.0,0.0,0.0,0.0,,,0.0,0.0,0.0,,,0.0 | 133 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,200,40,0.0,0.0,0.0,0.0,,,0.0,0.0,0.0,,,,0.0 | ||
| 134 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,200,40,0.99,0.975,1.0,1.0,651268854.0,651255808.0,3253.5364581272006,393.2519589434378,973.5832870006561,136.40537502942607,8593077474.0,0.0 | 134 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,200,40,0.99,0.975,1.0,1.0,651268854.0,651255808.0,3253.5364581272006,393.2519589434378,973.5832870006561,136.40537502942607,8593077474.0,8593077474.0,0.0 | ||
| 135 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,200,40,0.99,0.975,1.0,1.0,651268882.0,651255808.0,3351.503874640912,505.0313540850766,1057.6043623499572,144.29387502605096,8593069282.0,0.0 | 135 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,200,40,0.99,0.975,1.0,1.0,651268882.0,651255808.0,3351.503874640912,505.0313540850766,1057.6043623499572,144.29387502605096,8593069282.0,8593069282.0,0.0 | ||
| 136 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,200,40,0.975,0.945,0.995,1.0,183192937.0,183165696.0,3111.2300624372438,335.1737505290657,882.7701129950583,106.28564545186237,7628087269.0,0.0 | 136 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,200,40,0.975,0.945,0.995,1.0,183192937.0,183165696.0,3111.2300624372438,335.1737505290657,882.7701129950583,106.28564545186237,7628087269.0,7628087269.0,0.0 | ||
| 137 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,200,40,0.99,0.975,1.0,1.0,346006984.0,345979648.0,3146.7745005502366,358.00489655230194,916.1296371254139,108.4380624233745,7988651786.0,0.0 | 137 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,200,40,0.99,0.975,1.0,1.0,346006984.0,345979648.0,3146.7745005502366,358.00489655230194,916.1296371254139,108.4380624233745,7988651786.0,7988651786.0,0.0 | ||
| 138 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,200,40,0.185,0.16,0.21,1.0,162812727.0,162799616.0,3009.2775429366156,277.9904584749602,822.304554330185,89.87866656389087,7514240212.0,0.0 | 138 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,200,40,0.185,0.16,0.21,1.0,162812727.0,162799616.0,3009.2775429366156,277.9904584749602,822.304554330185,89.87866656389087,7514240212.0,7564825652.0,0.0 | ||
| 139 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,200,40,0.0,0.0,0.0,0.96,162812721.5,162799616.0,4281.923291040584,1580.5572919198312,2123.8540127058513,89.75787495728582,7514240212.0,0.0 | 139 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,200,40,0.0,0.0,0.0,0.96,162812721.5,162799616.0,4281.923291040584,1580.5572919198312,2123.8540127058513,89.75787495728582,7514240212.0,7564825652.0,0.0 | ||
| 140 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,200,40,0.985,0.965,1.0,1.0,162812766.0,162799616.0,3259.5277500804514,291.60412499913946,3259.5277500804514,91.043604479637,7514240212.0,0.0 | 140 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,200,40,0.985,0.965,1.0,1.0,162812766.0,162799616.0,3259.5277500804514,291.60412499913946,3259.5277500804514,91.043604479637,7514240212.0,7564825652.0,0.0 | ||
| 141 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,200,40,0.19,0.12,0.265,1.0,162812765.5,162799616.0,3129.6013329993,183.34420851897448,757.7406506170519,92.93381206225604,7514240212.0,0.0 | 141 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,200,40,0.19,0.12,0.265,1.0,162812765.5,162799616.0,3129.6013329993,183.34420851897448,757.7406506170519,92.93381206225604,7514240212.0,7564825652.0,0.0 | ||
| 142 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,200,40,0.975,0.95,0.995,1.0,162812673.0,162799616.0,3922.836207493674,962.149562605191,3922.836207493674,749.9465415021405,7672888236.0,0.0 | 142 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,200,40,0.975,0.95,0.995,1.0,162812673.0,162799616.0,3922.836207493674,962.149562605191,3922.836207493674,749.9465415021405,7672888236.0,7672888236.0,0.0 | ||
| 143 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,200,40,0.985,0.965,1.0,1.0,86514564.5,86487296.0,3211.8879585177638,287.61656302958727,3211.8879585177638,84.8972704843618,7378286352.0,0.0 | 143 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,200,40,0.985,0.965,1.0,1.0,86514564.5,86487296.0,3211.8879585177638,287.61656302958727,3211.8879585177638,84.8972704843618,7378286352.0,7564825652.0,0.0 | ||
| 144 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,200,40,0.0,0.0,0.0,1.0,0.0,,50.41495896875858,50.405958958435804,50.40775896050036,13.265561952721328,6243951240.0,0.0 | 144 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,200,40,0.0,0.0,0.0,1.0,0.0,,50.41495896875858,50.405958958435804,50.40775896050036,13.265561952721328,6243951240.0,6243951240.0,0.0 | ||
| 145 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,200,40,0.99,0.975,1.0,1.0,29207.5,,950.7843535975553,950.7768115727231,950.7783199776895,14.600520953536034,7155474496.0,0.0 | 145 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,200,40,0.99,0.975,1.0,1.0,29207.5,,950.7843535975553,950.7768115727231,950.7783199776895,14.600520953536034,7155474496.0,7155474496.0,0.0 | ||
| 146 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,200,40,0.195,0.16,0.23,1.0,2237.5,,111.21093755355105,106.68506246292964,107.22286257660016,13.600957987364382,6567653464.0,0.0 | 146 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,200,40,0.195,0.16,0.23,1.0,2237.5,,111.21093755355105,106.68506246292964,107.22286257660016,13.600957987364382,6567653464.0,6567653464.0,0.0 | ||
| 147 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,200,40,0.97,0.945,0.99,1.0,1359.0,,208.21972895646468,205.5006460286677,208.21972895646468,13.554833538364619,6562443352.0,0.0 | 147 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,200,40,0.97,0.945,0.99,1.0,1359.0,,208.21972895646468,205.5006460286677,208.21972895646468,13.554833538364619,6562443352.0,6562443352.0,0.0 | ||
| 148 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,200,40,0.375,0.355,0.395,1.0,1243.0,,157.0329790120013,152.3254174971953,153.43078373698518,13.57818697579205,6562246744.0,0.0 | 148 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,200,40,0.375,0.355,0.395,1.0,1243.0,,157.0329790120013,152.3254174971953,153.43078373698518,13.57818697579205,6562246744.0,6562246744.0,0.0 | ||
| 149 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|aware,A4,aware,120,40,0.9416666666666667,0.8916666666666667,0.9833333333333333,1.0,379.5,,3055.9733340051025,189.2200205475092,3055.9733340051025,13.356083014514297,6351775108.0,0.0 | 149 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|aware,A4,aware,120,40,0.9416666666666667,0.8916666666666667,0.9833333333333333,1.0,379.5,,3055.9733340051025,189.2200205475092,3055.9733340051025,13.356083014514297,6351775108.0,6351775108.0,0.0 | ||
| 150 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,200,40,0.375,0.29,0.46,1.0,1424.5,,7449.7145840432495,127.20972893293947,1638.8054550508969,13.581104576587677,6567653464.0,0.0 | 150 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,200,40,0.375,0.29,0.46,1.0,1424.5,,7449.7145840432495,127.20972893293947,1638.8054550508969,13.581104576587677,6567653464.0,6567653464.0,0.0 | ||
| 151 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|aware,A5,aware,120,40,1.0,1.0,1.0,1.0,118.0,,2137.8979585133493,178.15022950526327,2137.8979585133493,13.383313023950905,6300656332.0,0.0 | 151 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|aware,A5,aware,120,40,1.0,1.0,1.0,1.0,118.0,,2137.8979585133493,178.15022950526327,2137.8979585133493,13.383313023950905,6300656332.0,6300656332.0,0.0 | ||
| 152 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,200,40,0.15,0.12,0.175,1.0,827.0,,8156.952459132299,82.95993698993698,1699.9364422634244,13.478271022904664,6524249846.0,0.0 | 152 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,200,40,0.15,0.12,0.175,1.0,827.0,,8156.952459132299,82.95993698993698,1699.9364422634244,13.478271022904664,6524249846.0,6524249846.0,0.0 | ||
| 153 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,200,40,0.18,0.145,0.215,1.0,627.0,,169.26231351681054,169.23870902974159,169.24342992715538,13.843645516317338,6813358062.0,1490.29 | 153 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,200,40,0.18,0.145,0.215,1.0,627.0,,169.26231351681054,169.23870902974159,169.24342992715538,13.843645516317338,6813358062.0,6813358062.0,1490.29 | ||
| 154 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,200,40,0.99,0.975,1.0,1.0,2726.0,,1031.9313738727942,1031.8554784171283,1031.8706575082615,14.829437481239438,7155474496.0,0.0 | 154 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,200,40,0.99,0.975,1.0,1.0,2726.0,,1031.9313738727942,1031.8554784171283,1031.8706575082615,14.829437481239438,7155474496.0,7155474496.0,0.0 | ||
| 155 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,200,40,0.135,0.09,0.185,1.0,2566.5,,1293.5829174821265,162.30137506499887,364.1857292270288,13.750895974226296,6603747416.0,0.0 | 155 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,200,40,0.135,0.09,0.185,1.0,2566.5,,1293.5829174821265,162.30137506499887,364.1857292270288,13.750895974226296,6603747416.0,6603747416.0,0.0 | ||
| 156 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,200,40,0.99,0.975,1.0,1.0,215559973.0,215543808.0,1760.9770625131205,187.03570862999186,489.1586328856647,47.34012502012774,6902325564.0,0.0 | 156 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,200,40,0.99,0.975,1.0,1.0,215559973.0,215543808.0,1760.9770625131205,187.03570862999186,489.1586328856647,47.34012502012774,6902325564.0,7155474496.0,0.0 | ||
| 157 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,200,40,0.99,0.975,1.0,1.0,215560001.0,215543808.0,1249.4945833459496,211.0927085741423,428.1928248470649,47.08545847097412,6902210788.0,0.0 | 157 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,200,40,0.99,0.975,1.0,1.0,215560001.0,215543808.0,1249.4945833459496,211.0927085741423,428.1928248470649,47.08545847097412,6902210788.0,7155474496.0,0.0 | ||
| 158 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,200,40,0.0,0.0,0.0,0.925,60655936.0,60621696.0,1706.1032095225528,737.6006674603559,957.3284577345476,28.023312508594245,6617885472.0,0.0 | 158 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,200,40,0.0,0.0,0.0,0.925,60655936.0,60621696.0,1706.1032095225528,737.6006674603559,957.3284577345476,28.023312508594245,6617885472.0,7155474496.0,0.0 | ||
| 159 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,200,40,0.99,0.975,1.0,1.0,114541977.0,114507648.0,1375.615374010522,174.04247901868075,427.2855912684463,31.199354503769428,6737391200.0,0.0 | 159 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,200,40,0.99,0.975,1.0,1.0,114541977.0,114507648.0,1375.615374010522,174.04247901868075,427.2855912684463,31.199354503769428,6737391200.0,7155474496.0,0.0 | ||
| 160 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,200,40,0.2,0.175,0.23,1.0,53892924.5,53876736.0,1106.2013980117626,122.37893755082041,344.84630380757153,24.08345852745697,6547349820.0,0.0 | 160 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,200,40,0.2,0.175,0.23,1.0,53892924.5,53876736.0,1106.2013980117626,122.37893755082041,344.84630380757153,24.08345852745697,6547349820.0,7155474496.0,0.0 | ||
| 161 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,200,40,0.0,0.0,0.0,0.93,53892919.5,53876736.0,1658.0170001252554,676.7245414666831,892.330970952753,24.060583498794585,6547349820.0,0.0 | 161 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,200,40,0.0,0.0,0.0,0.93,53892919.5,53876736.0,1658.0170001252554,676.7245414666831,892.330970952753,24.060583498794585,6547349820.0,7155474496.0,0.0 | ||
| 162 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,200,40,0.78,0.725,0.83,1.0,53892964.5,53876736.0,1236.3030216074549,136.36277109617367,1236.3030216074549,23.683937499299645,6546481380.0,0.0 | 162 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,200,40,0.78,0.725,0.83,1.0,53892964.5,53876736.0,1236.3030216074549,136.36277109617367,1236.3030216074549,23.683937499299645,6546481380.0,7155474496.0,0.0 | ||
| 163 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,200,40,0.12,0.075,0.17,1.0,53892964.5,53876736.0,1218.1062293238938,101.19929199572653,340.085291385185,23.96877051796764,6546481380.0,0.0 | 163 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,200,40,0.12,0.075,0.17,1.0,53892964.5,53876736.0,1218.1062293238938,101.19929199572653,340.085291385185,23.96877051796764,6546481380.0,7155474496.0,0.0 | ||
| 164 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,200,40,0.66,0.61,0.705,1.0,53892854.5,53876736.0,1639.2308954964392,539.650562859606,1639.2308954964392,414.88808300346136,6584983866.0,0.0 | 164 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,200,40,0.66,0.61,0.705,1.0,53892854.5,53876736.0,1639.2308954964392,539.650562859606,1639.2308954964392,414.88808300346136,6584983866.0,7155474496.0,0.0 | ||
| 165 | −synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,200,40,0.785,0.73,0.835,1.0,28656329.0,28622016.0,1268.601355026476,140.13310411246493,1268.601355026476,21.49270853260532,6506618028.0,0.0 | 165 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,200,40,0.785,0.73,0.835,1.0,28656329.0,28622016.0,1268.601355026476,140.13310411246493,1268.601355026476,21.49270853260532,6506618028.0,7155474496.0,0.0 | ||
modified
results/tables/E4_core_h4_primary_tests.csv
+1 −1
@@ -1,2 +1,2 @@ | |||||
| 1 | a,b,diff,lo,hi,p,n,n_clusters,mean_a,mean_b,rel_change,name,hypothesis,p_holm | 1 | a,b,diff,lo,hi,p,n,n_clusters,mean_a,mean_b,rel_change,name,hypothesis,p_holm | ||
| 2 | −A5|closed|qwen3b,A4|closed|qwen3b,-0.1037037037037037,-0.1962962962962963,-0.014814814814814815,0.029,270,18,0.27037037037037037,0.37407407407407406,-0.27722772277227725,T5 A5 chain vs A4 chain at 4 handoffs (closed),H5,0.029 | 2 | +A5|closed|qwen3b,A4|closed|qwen3b,-0.12,-0.20666666666666667,-0.02991666666666712,0.013,300,20,0.26666666666666666,0.38666666666666666,-0.3103448275862069,T5 A5 chain vs A4 chain at 4 handoffs (closed),H5,0.013 | ||
modified
results/tables/E4_core_handoffs.csv
+24 −24
@@ -1,25 +1,25 @@ | |||||
| 1 | chain,handoffs,accuracy,acc_lo,acc_hi,retention,ret_lo,ret_hi,unsupported_mean,fetched_bytes_mean,msg_bytes_mean,n,n_docs | 1 | chain,handoffs,accuracy,acc_lo,acc_hi,retention,ret_lo,ret_hi,unsupported_mean,fetched_bytes_mean,msg_bytes_mean,n,n_docs | ||
| 2 | −A4|closed|qwen3b-llama3b,1,0.3764705882352941,0.2920588235294118,0.4627450980392157,0.2997403349599513,0.21457867065318473,0.3869957002281858,0.0,0.0,1348.7058823529412,255,17 | 2 | +A4|closed|qwen3b-llama3b,1,0.39666666666666667,0.31333333333333335,0.4784166666666666,0.3213477162843902,0.24051447018751054,0.3990021508568352,0.0,0.0,1335.1,300,20 | ||
| 3 | −A4|closed|qwen3b-llama3b,2,0.3803921568627451,0.3058823529411765,0.4588235294117647,0.2997403349599513,0.21457867065318473,0.3869957002281858,0.0,0.0,1295.9411764705883,255,17 | 3 | +A4|closed|qwen3b-llama3b,2,0.4033333333333333,0.33,0.4784166666666666,0.31896676390343776,0.2388578879687949,0.396724937377807,0.0,0.0,1292.7,300,20 | ||
| 4 | −A4|closed|qwen3b-llama3b,4,0.37254901960784315,0.29990196078431375,0.44911764705882345,0.2939994929697927,0.20919293364752228,0.3796107713871142,0.0,0.0,1196.8823529411766,255,17 | 4 | +A4|closed|qwen3b-llama3b,4,0.39666666666666667,0.31983333333333336,0.4766666666666667,0.31332947245422715,0.2338895058259791,0.39140045635421616,0.0,0.0,1204.35,300,20 | ||
| 5 | −A4|closed|qwen3b-llama3b,8,0.3607843137254902,0.27450980392156865,0.4569607843137254,0.28477327682351017,0.20162554174350086,0.3731548822718816,0.0,0.0,1087.4117647058824,255,17 | 5 | +A4|closed|qwen3b-llama3b,8,0.38666666666666666,0.29333333333333333,0.4766666666666667,0.305487188729887,0.22485206259538051,0.38613828395117317,0.0,0.0,1111.65,300,20 | ||
| 6 | −A4|closed|qwen3b,1,0.3851851851851852,0.3037037037037037,0.46296296296296297,0.31556672660747537,0.23471613693176427,0.3999038582684665,0.0,0.0,1339.2777777777778,270,18 | 6 | +A4|closed|qwen3b,1,0.39666666666666667,0.31333333333333335,0.4784166666666666,0.3213477162843902,0.24051447018751054,0.3990021508568352,0.0,0.0,1335.1,300,20 | ||
| 7 | −A4|closed|qwen3b,2,0.37407407407407406,0.29259259259259257,0.45555555555555555,0.31198249721679433,0.23020870973034613,0.397220313896269,0.0,0.0,1189.5555555555557,270,18 | 7 | +A4|closed|qwen3b,2,0.38666666666666666,0.29825,0.4717499999999999,0.31812190983277727,0.23827969389124584,0.3963697907674928,0.0,0.0,1200.35,300,20 | ||
| 8 | −A4|closed|qwen3b,4,0.37407407407407406,0.29259259259259257,0.45555555555555555,0.3085102749945721,0.22808095562665784,0.3920547786340022,0.0,0.0,1162.111111111111,270,18 | 8 | +A4|closed|qwen3b,4,0.38666666666666666,0.29825,0.4717499999999999,0.3149969098327773,0.23706777575550922,0.3915214606368333,0.0,0.0,1175.65,300,20 | ||
| 9 | −A4|closed|qwen3b,8,0.3814814814814815,0.29259259259259257,0.4666666666666667,0.3085102749945721,0.22808095562665784,0.3920547786340022,0.0,0.0,1161.0555555555557,270,18 | 9 | +A4|closed|qwen3b,8,0.3933333333333333,0.30333333333333334,0.48,0.3149969098327773,0.23706777575550922,0.3915214606368333,0.0,0.0,1174.7,300,20 | ||
| 10 | −A4|repairable|qwen3b,1,0.3764705882352941,0.2920588235294118,0.4627450980392157,0.2997403349599513,0.21457867065318473,0.3869957002281858,0.0,0.0,1348.7058823529412,255,17 | 10 | +A4|repairable|qwen3b,1,0.39666666666666667,0.31333333333333335,0.4784166666666666,0.3213477162843902,0.24051447018751054,0.3990021508568352,0.0,0.0,1335.1,300,20 | ||
| 11 | −A4|repairable|qwen3b,2,0.4117647058823529,0.3333333333333333,0.49019607843137253,0.34433809830771467,0.2635025835750893,0.4163276358495137,0.0,830.1764705882352,1289.8235294117646,255,17 | 11 | +A4|repairable|qwen3b,2,0.42333333333333334,0.35,0.5001666666666665,0.3577173535915275,0.28124865199064863,0.4237092895154752,0.05,844.1,1283.2,300,20 | ||
| 12 | −A4|repairable|qwen3b,4,0.4235294117647059,0.3333333333333333,0.49411764705882355,0.3715110887159992,0.29655520277764474,0.43621401726286024,0.0,2490.529411764706,1212.6470588235295,255,17 | 12 | +A4|repairable|qwen3b,4,0.43333333333333335,0.36333333333333334,0.5066666666666667,0.3808143954385693,0.312176448615584,0.4407750070228039,0.05,2532.3,1214.45,300,20 | ||
| 13 | −A4|repairable|qwen3b,8,0.42745098039215684,0.33725490196078434,0.5019607843137255,0.3715110887159992,0.29655520277764474,0.43621401726286024,0.0,5811.235294117647,1211.5294117647059,255,17 | 13 | +A4|repairable|qwen3b,8,0.43666666666666665,0.36491666666666667,0.5084166666666666,0.3808143954385693,0.312176448615584,0.4407750070228039,0.05,5908.7,1213.5,300,20 | ||
| 14 | −A5|closed|qwen3b-llama3b,1,0.2823529411764706,0.24313725490196078,0.3176470588235294,0.17483857864652055,0.1494914321297303,0.19947843566193868,0.0,0.0,744.7058823529412,255,17 | 14 | +A5|closed|qwen3b-llama3b,1,0.2733333333333333,0.24666666666666667,0.30333333333333334,0.17491648815323876,0.15103519762359272,0.19681276169193201,0.0,0.0,751.85,300,20 | ||
| 15 | −A5|closed|qwen3b-llama3b,2,0.30196078431372547,0.2724509803921569,0.3333333333333333,0.20163529494851135,0.18206329172922364,0.22029894567998026,0.0,0.0,960.7647058823529,255,17 | 15 | +A5|closed|qwen3b-llama3b,2,0.29333333333333333,0.26666666666666666,0.3250833333333332,0.20158980090603484,0.18215503297616462,0.22065797308626922,0.0,0.0,952.65,300,20 | ||
| 16 | −A5|closed|qwen3b-llama3b,4,0.2980392156862745,0.26666666666666666,0.3333333333333333,0.20163529494851135,0.18206329172922364,0.22029894567998026,0.0,0.0,983.5294117647059,255,17 | 16 | +A5|closed|qwen3b-llama3b,4,0.29,0.26,0.3233333333333333,0.20158980090603484,0.18215503297616462,0.22065797308626922,0.0,0.0,977.35,300,20 | ||
| 17 | −A5|closed|qwen3b-llama3b,8,0.2980392156862745,0.2685294117647059,0.3333333333333333,0.20163529494851135,0.18206329172922364,0.22029894567998026,0.0,0.0,983.5294117647059,255,17 | 17 | +A5|closed|qwen3b-llama3b,8,0.29,0.2633333333333333,0.3217499999999999,0.20158980090603484,0.18215503297616462,0.22065797308626922,0.0,0.0,977.35,300,20 | ||
| 18 | −A5|closed|qwen3b,1,0.2777777777777778,0.24444444444444444,0.3167592592592592,0.18136464051658566,0.15648040685178966,0.21033222834242798,0.0,0.0,749.7777777777778,270,18 | 18 | +A5|closed|qwen3b,1,0.2733333333333333,0.24666666666666667,0.30333333333333334,0.17491648815323876,0.15103519762359272,0.19681276169193201,0.0,0.0,751.85,300,20 | ||
| 19 | −A5|closed|qwen3b,2,0.26296296296296295,0.23333333333333334,0.29824074074074064,0.1798353106270407,0.1509785338633097,0.21144416514719916,0.0,0.0,706.4444444444445,270,18 | 19 | +A5|closed|qwen3b,2,0.26,0.23333333333333334,0.29,0.17426159197414903,0.148142183355459,0.1991388221983684,0.0,0.0,709.1,300,20 | ||
| 20 | −A5|closed|qwen3b,4,0.27037037037037037,0.24074074074074073,0.3074074074074074,0.1798353106270407,0.1509785338633097,0.21144416514719916,0.0,0.0,706.4444444444445,270,18 | 20 | +A5|closed|qwen3b,4,0.26666666666666666,0.24333333333333335,0.3,0.17426159197414903,0.148142183355459,0.1991388221983684,0.0,0.0,709.1,300,20 | ||
| 21 | −A5|closed|qwen3b,8,0.27450980392156865,0.23921568627450981,0.31186274509803913,0.17321928817523768,0.1417754973886688,0.20031953957329943,0.0,0.0,698.8235294117648,255,17 | 21 | +A5|closed|qwen3b,8,0.26666666666666666,0.24333333333333335,0.3,0.17426159197414903,0.148142183355459,0.1991388221983684,0.0,0.0,709.1,300,20 | ||
| 22 | −A5|repairable|qwen3b,1,0.2823529411764706,0.24313725490196078,0.3176470588235294,0.17483857864652055,0.1494914321297303,0.19947843566193868,0.0,0.0,744.7058823529412,255,17 | 22 | +A5|repairable|qwen3b,1,0.2733333333333333,0.24666666666666667,0.30333333333333334,0.17491648815323876,0.15103519762359272,0.19681276169193201,0.0,0.0,751.85,300,20 | ||
| 23 | −A5|repairable|qwen3b,2,0.26666666666666666,0.22931372549019613,0.3058823529411765,0.1876961353547222,0.15947604023307319,0.21310193990334425,0.0,898.2941176470588,690.7058823529412,255,17 | 23 | +A5|repairable|qwen3b,2,0.26,0.23,0.29333333333333333,0.18974151525131408,0.1614175785475652,0.21394241158486169,0.0,847.6,710.5,300,20 | ||
| 24 | −A5|repairable|qwen3b,4,0.27058823529411763,0.23137254901960785,0.30980392156862746,0.19416234466723137,0.17161243865971046,0.21600566106635635,0.0,2475.235294117647,729.7647058823529,255,17 | 24 | +A5|repairable|qwen3b,4,0.2633333333333333,0.23666666666666666,0.2966666666666667,0.19523779316694684,0.17310645675620093,0.2162458360488423,0.0,2356.1,743.7,300,20 | ||
| 25 | −A5|repairable|qwen3b,8,0.27058823529411763,0.23137254901960785,0.30980392156862746,0.19416234466723137,0.17161243865971046,0.21600566106635635,0.0,5629.117647058823,729.7647058823529,255,17 | 25 | +A5|repairable|qwen3b,8,0.2633333333333333,0.23666666666666666,0.2966666666666667,0.19523779316694684,0.17310645675620093,0.2162458360488423,0.0,5373.1,743.7,300,20 | ||
modified
results/tables/E5_core_fanin.csv
+50 −50
@@ -1,51 +1,51 @@ | |||||
| 1 | condition,qtype,quality,lo,hi,n,payload_bytes_median,fetched_bytes_mean | 1 | condition,qtype,quality,lo,hi,n,payload_bytes_median,fetched_bytes_mean | ||
| 2 | −cache_concat_negative_control|k=2,aggregation,0.0,0.0,0.0,13,87035904.0,0.0 | 2 | +cache_concat_negative_control|k=2,aggregation,0.0,0.0,0.0,20,159418368.0,0.0 | ||
| 3 | −cache_concat_negative_control|k=2,multi_hop,0.7307692307692307,0.5769230769230769,0.8846153846153846,26,87035904.0,0.0 | 3 | +cache_concat_negative_control|k=2,multi_hop,0.7,0.575,0.825,40,159418368.0,0.0 | ||
| 4 | −cache_concat_negative_control|k=2,revision,0.5,0.3076923076923077,0.6538461538461539,26,87035904.0,0.0 | 4 | +cache_concat_negative_control|k=2,revision,0.5,0.35,0.65,40,159418368.0,0.0 | ||
| 5 | −cache_concat_negative_control|k=2,temporal,0.6153846153846154,0.34423076923077006,0.8461538461538461,13,87035904.0,0.0 | 5 | +cache_concat_negative_control|k=2,temporal,0.55,0.35,0.75,20,159418368.0,0.0 | ||
| 6 | −cache_concat_negative_control|k=2,unanswerable,1.0,1.0,1.0,26,87035904.0,0.0 | 6 | +cache_concat_negative_control|k=2,unanswerable,1.0,1.0,1.0,40,159418368.0,0.0 | ||
| 7 | −cache_concat_negative_control|k=4,aggregation,0.0,0.0,0.0,12,164081664.0,0.0 | 7 | +cache_concat_negative_control|k=4,aggregation,0.0,0.0,0.0,20,166496256.0,0.0 | ||
| 8 | −cache_concat_negative_control|k=4,multi_hop,0.5833333333333334,0.3947916666666671,0.75,24,164081664.0,0.0 | 8 | +cache_concat_negative_control|k=4,multi_hop,0.525,0.4,0.675,40,166496256.0,0.0 | ||
| 9 | −cache_concat_negative_control|k=4,revision,0.25,0.125,0.375,24,164081664.0,0.0 | 9 | +cache_concat_negative_control|k=4,revision,0.25,0.125,0.4,40,166496256.0,0.0 | ||
| 10 | −cache_concat_negative_control|k=4,temporal,0.4166666666666667,0.16666666666666666,0.6666666666666666,12,164081664.0,0.0 | 10 | +cache_concat_negative_control|k=4,temporal,0.4,0.2,0.6,20,166496256.0,0.0 | ||
| 11 | −cache_concat_negative_control|k=4,unanswerable,0.9583333333333334,0.875,1.0,24,164081664.0,0.0 | 11 | +cache_concat_negative_control|k=4,unanswerable,0.975,0.9118750000000003,1.0,40,166496256.0,0.0 | ||
| 12 | −concat_A4|k=2,aggregation,0.0,0.0,0.0,13,2568.0,0.0 | 12 | +concat_A4|k=2,aggregation,0.0,0.0,0.0,20,2585.0,0.0 | ||
| 13 | −concat_A4|k=2,multi_hop,0.9230769230769231,0.8076923076923077,1.0,26,2568.0,0.0 | 13 | +concat_A4|k=2,multi_hop,0.925,0.85,0.9881249999999995,40,2585.0,0.0 | ||
| 14 | −concat_A4|k=2,revision,0.5769230769230769,0.38461538461538464,0.7692307692307693,26,2568.0,0.0 | 14 | +concat_A4|k=2,revision,0.7,0.55,0.85,40,2585.0,0.0 | ||
| 15 | −concat_A4|k=2,temporal,0.6923076923076923,0.46153846153846156,0.9230769230769231,13,2568.0,0.0 | 15 | +concat_A4|k=2,temporal,0.6,0.35,0.8,20,2585.0,0.0 | ||
| 16 | −concat_A4|k=2,unanswerable,1.0,1.0,1.0,26,2568.0,0.0 | 16 | +concat_A4|k=2,unanswerable,1.0,1.0,1.0,40,2585.0,0.0 | ||
| 17 | −concat_A4|k=4,aggregation,0.0,0.0,0.0,12,6079.0,0.0 | 17 | +concat_A4|k=4,aggregation,0.0,0.0,0.0,20,6019.5,0.0 | ||
| 18 | −concat_A4|k=4,multi_hop,0.9583333333333334,0.875,1.0,24,6079.0,0.0 | 18 | +concat_A4|k=4,multi_hop,0.925,0.85,1.0,40,6019.5,0.0 | ||
| 19 | −concat_A4|k=4,revision,0.7083333333333334,0.5416666666666666,0.875,24,6079.0,0.0 | 19 | +concat_A4|k=4,revision,0.65,0.5,0.8,40,6019.5,0.0 | ||
| 20 | −concat_A4|k=4,temporal,0.75,0.5,1.0,12,6079.0,0.0 | 20 | +concat_A4|k=4,temporal,0.65,0.45,0.85,20,6019.5,0.0 | ||
| 21 | −concat_A4|k=4,unanswerable,1.0,1.0,1.0,24,6079.0,0.0 | 21 | +concat_A4|k=4,unanswerable,1.0,1.0,1.0,40,6019.5,0.0 | ||
| 22 | −full_context|k=2,aggregation,0.0,0.0,0.0,13,8557.0,0.0 | 22 | +full_context|k=2,aggregation,0.0,0.0,0.0,20,19305.5,0.0 | ||
| 23 | −full_context|k=2,multi_hop,0.9615384615384616,0.8846153846153846,1.0,26,8557.0,0.0 | 23 | +full_context|k=2,multi_hop,0.975,0.925,1.0,40,19305.5,0.0 | ||
| 24 | −full_context|k=2,revision,0.6153846153846154,0.46153846153846156,0.7692307692307693,26,8557.0,0.0 | 24 | +full_context|k=2,revision,0.6,0.5,0.7131249999999993,40,19305.5,0.0 | ||
| 25 | −full_context|k=2,temporal,0.6923076923076923,0.46153846153846156,0.9230769230769231,13,8557.0,0.0 | 25 | +full_context|k=2,temporal,0.7,0.5,0.9,20,19305.5,0.0 | ||
| 26 | −full_context|k=2,unanswerable,1.0,1.0,1.0,26,8557.0,0.0 | 26 | +full_context|k=2,unanswerable,1.0,1.0,1.0,40,19305.5,0.0 | ||
| 27 | −full_context|k=4,aggregation,0.0,0.0,0.0,13,9061.0,0.0 | 27 | +full_context|k=4,aggregation,0.0,0.0,0.0,20,19809.5,0.0 | ||
| 28 | −full_context|k=4,multi_hop,0.9615384615384616,0.8846153846153846,1.0,26,9061.0,0.0 | 28 | +full_context|k=4,multi_hop,0.95,0.875,1.0,40,19809.5,0.0 | ||
| 29 | −full_context|k=4,revision,0.6538461538461539,0.5,0.8076923076923077,26,9061.0,0.0 | 29 | +full_context|k=4,revision,0.625,0.5,0.75,40,19809.5,0.0 | ||
| 30 | −full_context|k=4,temporal,0.5384615384615384,0.3076923076923077,0.7692307692307693,13,9061.0,0.0 | 30 | +full_context|k=4,temporal,0.5,0.3,0.75,20,19809.5,0.0 | ||
| 31 | −full_context|k=4,unanswerable,1.0,1.0,1.0,26,9061.0,0.0 | 31 | +full_context|k=4,unanswerable,1.0,1.0,1.0,40,19809.5,0.0 | ||
| 32 | −merge_A5|k=2,aggregation,0.0,0.0,0.0,13,1540.0,0.0 | 32 | +merge_A5|k=2,aggregation,0.0,0.0,0.0,20,1518.0,0.0 | ||
| 33 | −merge_A5|k=2,multi_hop,0.23076923076923078,0.11538461538461539,0.366346153846153,26,1540.0,0.0 | 33 | +merge_A5|k=2,multi_hop,0.225,0.125,0.35,40,1518.0,0.0 | ||
| 34 | −merge_A5|k=2,revision,0.19230769230769232,0.07692307692307693,0.34615384615384615,26,1540.0,0.0 | 34 | +merge_A5|k=2,revision,0.15,0.05,0.25,40,1518.0,0.0 | ||
| 35 | −merge_A5|k=2,temporal,0.46153846153846156,0.23076923076923078,0.732692307692306,13,1540.0,0.0 | 35 | +merge_A5|k=2,temporal,0.55,0.35,0.8,20,1518.0,0.0 | ||
| 36 | −merge_A5|k=2,unanswerable,1.0,1.0,1.0,26,1540.0,0.0 | 36 | +merge_A5|k=2,unanswerable,1.0,1.0,1.0,40,1518.0,0.0 | ||
| 37 | −merge_A5|k=4,aggregation,0.0,0.0,0.0,12,2827.0,0.0 | 37 | +merge_A5|k=4,aggregation,0.0,0.0,0.0,20,2933.5,0.0 | ||
| 38 | −merge_A5|k=4,multi_hop,0.3333333333333333,0.125,0.5833333333333334,24,2827.0,0.0 | 38 | +merge_A5|k=4,multi_hop,0.325,0.175,0.475,40,2933.5,0.0 | ||
| 39 | −merge_A5|k=4,revision,0.5,0.375,0.625,24,2827.0,0.0 | 39 | +merge_A5|k=4,revision,0.45,0.35,0.55,40,2933.5,0.0 | ||
| 40 | −merge_A5|k=4,temporal,0.3333333333333333,0.08333333333333333,0.5833333333333334,12,2827.0,0.0 | 40 | +merge_A5|k=4,temporal,0.45,0.25,0.65,20,2933.5,0.0 | ||
| 41 | −merge_A5|k=4,unanswerable,1.0,1.0,1.0,24,2827.0,0.0 | 41 | +merge_A5|k=4,unanswerable,0.975,0.925,1.0,40,2933.5,0.0 | ||
| 42 | −shared_memory_A6|k=2,aggregation,0.0,0.0,0.0,13,3029.0,1414.1538461538462 | 42 | +shared_memory_A6|k=2,aggregation,0.0,0.0,0.0,20,2985.5,1425.8 | ||
| 43 | −shared_memory_A6|k=2,multi_hop,0.4230769230769231,0.23076923076923078,0.5769230769230769,26,3012.5,1381.6538461538462 | 43 | +shared_memory_A6|k=2,multi_hop,0.375,0.225,0.525,40,2967.5,1393.75 | ||
| 44 | −shared_memory_A6|k=2,revision,0.4230769230769231,0.19230769230769232,0.6740384615384607,26,2993.0,1383.8076923076924 | 44 | +shared_memory_A6|k=2,revision,0.45,0.3,0.625,40,2967.5,1398.125 | ||
| 45 | −shared_memory_A6|k=2,temporal,0.46153846153846156,0.23076923076923078,0.6923076923076923,13,2993.0,1369.7692307692307 | 45 | +shared_memory_A6|k=2,temporal,0.35,0.2,0.55,20,2964.0,1386.25 | ||
| 46 | −shared_memory_A6|k=2,unanswerable,1.0,1.0,1.0,26,2993.0,1388.7692307692307 | 46 | +shared_memory_A6|k=2,unanswerable,1.0,1.0,1.0,40,2967.5,1401.5 | ||
| 47 | −shared_memory_A6|k=4,aggregation,0.0,0.0,0.0,12,6531.0,3424.0833333333335 | 47 | +shared_memory_A6|k=4,aggregation,0.0,0.0,0.0,20,6438.5,3345.15 | ||
| 48 | −shared_memory_A6|k=4,multi_hop,0.625,0.4166666666666667,0.7916666666666666,24,6382.5,3310.5 | 48 | +shared_memory_A6|k=4,multi_hop,0.6,0.45,0.75,40,6375.5,3236.6 | ||
| 49 | −shared_memory_A6|k=4,revision,0.7916666666666666,0.625,0.9583333333333334,24,6525.5,3413.2083333333335 | 49 | +shared_memory_A6|k=4,revision,0.675,0.5,0.85,40,6424.5,3333.3 | ||
| 50 | −shared_memory_A6|k=4,temporal,0.4166666666666667,0.16666666666666666,0.7104166666666647,12,6369.0,3278.4166666666665 | 50 | +shared_memory_A6|k=4,temporal,0.45,0.25,0.65,20,6338.0,3210.75 | ||
| 51 | −shared_memory_A6|k=4,unanswerable,1.0,1.0,1.0,24,6490.0,3377.9583333333335 | 51 | +shared_memory_A6|k=4,unanswerable,1.0,1.0,1.0,40,6396.0,3295.975 | ||
modified
runs/raw/E1_core.jsonl
+206 −0
@@ -13278,3 +13278,209 @@ | |||||
| 13278 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "84bbaf2a21d6dfecb8456f19", "attempt_id": "ad950087d4ae", "run_group_id": "E1_core:B5|keep_frac=0.25|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5f903477abec1bb5d55c3fdb62f0e7cdaa6e271a6ce76c4c24f2aed85f54972d", "git_commit": null, "timestamp_utc": "2026-10-30T08:15:52.136967Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 6713603080}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1833, "keep": 458, "window_tokens": 19, "compress_ms": 125.84658397827297}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 45, "message_tokens": 1833, "message_utf8_bytes": 7797, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540027, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 140.92112495563924, "doc_prefill_ms": 755.7172500528395, "compress_ms": 126.0839580791071, "serialize_ms": 14.624499948695302, "load_ms": 10.735749965533614, "receiver_prefill_ms": 0.0, "query_prefill_ms": 103.52437500841916, "ttft_ms": 103.52437500841916, "decode_ms": 2015.076957992278}, "total_wall_ms": 2131.282207905315, "ttft_ms": 103.52437500841916, "input_usage": {"receiver_prefix_tokens": 1833, "dense_cache_bytes": 210223104, "query_tokens": 45}, "output_usage": {"output_tokens": 70}, "provider_cached_usage": null, "process_memory": 4553031680, "backend_memory": {"mlx_active_bytes": 6779663368, "mlx_peak_bytes": 6849033452, "mlx_cache_bytes": 13443453829, "process_rss_bytes": 4553031680}, "peak_prefill_memory": 7114248584, "peak_decode_memory": 6849033452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for row in rows:\n if row['region'] != 'Nord':\n if row['units'] >= 3 and not row['returned']:\n total += round((row['revenue'] - row['tax']), 1)\n return total\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5907933544f257f57e41fadb2827662a780493ad8e442fa27efe35d6d32505f5", "output_hash": "aa8d4725e560d4c26ae00620d85317c9bb6483e7b7e31337cdf63bc5721b6bb9"} | 13278 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "84bbaf2a21d6dfecb8456f19", "attempt_id": "ad950087d4ae", "run_group_id": "E1_core:B5|keep_frac=0.25|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5f903477abec1bb5d55c3fdb62f0e7cdaa6e271a6ce76c4c24f2aed85f54972d", "git_commit": null, "timestamp_utc": "2026-10-30T08:15:52.136967Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 6713603080}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1833, "keep": 458, "window_tokens": 19, "compress_ms": 125.84658397827297}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 45, "message_tokens": 1833, "message_utf8_bytes": 7797, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540027, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 140.92112495563924, "doc_prefill_ms": 755.7172500528395, "compress_ms": 126.0839580791071, "serialize_ms": 14.624499948695302, "load_ms": 10.735749965533614, "receiver_prefill_ms": 0.0, "query_prefill_ms": 103.52437500841916, "ttft_ms": 103.52437500841916, "decode_ms": 2015.076957992278}, "total_wall_ms": 2131.282207905315, "ttft_ms": 103.52437500841916, "input_usage": {"receiver_prefix_tokens": 1833, "dense_cache_bytes": 210223104, "query_tokens": 45}, "output_usage": {"output_tokens": 70}, "provider_cached_usage": null, "process_memory": 4553031680, "backend_memory": {"mlx_active_bytes": 6779663368, "mlx_peak_bytes": 6849033452, "mlx_cache_bytes": 13443453829, "process_rss_bytes": 4553031680}, "peak_prefill_memory": 7114248584, "peak_decode_memory": 6849033452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for row in rows:\n if row['region'] != 'Nord':\n if row['units'] >= 3 and not row['returned']:\n total += round((row['revenue'] - row['tax']), 1)\n return total\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5907933544f257f57e41fadb2827662a780493ad8e442fa27efe35d6d32505f5", "output_hash": "aa8d4725e560d4c26ae00620d85317c9bb6483e7b7e31337cdf63bc5721b6bb9"} | ||
| 13279 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "73bbd85f92bf3017ceda8b93", "attempt_id": "3d7da555db3f", "run_group_id": "E1_core:B6|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5f903477abec1bb5d55c3fdb62f0e7cdaa6e271a6ce76c4c24f2aed85f54972d", "git_commit": null, "timestamp_utc": "2026-10-30T08:15:54.319962Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 6660387848}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 1833, "keep": 458, "window_tokens": 45, "compress_ms": 237.40212502889335}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 45, "message_tokens": 1833, "message_utf8_bytes": 7797, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539987, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 255.0340419402346, "doc_prefill_ms": 755.7172500528395, "compress_ms": 239.0654580667615, "serialize_ms": 15.727957943454385, "load_ms": 1.3509170385077596, "receiver_prefill_ms": 0.0, "query_prefill_ms": 775.9203750174493, "ttft_ms": 775.9203750174493, "decode_ms": 2776.375083019957}, "total_wall_ms": 3810.6947500491515, "ttft_ms": 775.9203750174493, "input_usage": {"receiver_prefix_tokens": 1833, "dense_cache_bytes": 210223104, "query_tokens": 45}, "output_usage": {"output_tokens": 95}, "provider_cached_usage": null, "process_memory": 4607213568, "backend_memory": {"mlx_active_bytes": 6782727176, "mlx_peak_bytes": 6846201008, "mlx_cache_bytes": 13776941673, "process_rss_bytes": 4607213568}, "peak_prefill_memory": 7114248584, "peak_decode_memory": 6846201008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'Brasil' and r['shipped_days'] > 0 and r['shipped_days'] <= 30 and r['units'] >= 3:\n total += r['units'] * (r['price'] - r['price_tax']) / 100\n return round(total, 1)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cbc5f4cdd11689900f722fe2822fc2a4a031a0cc67275e5a2436979af1406516", "output_hash": "9634503ef64bad26ab9c39f04ebe241d55fc598b541570c1090e88839a2a9778"} | 13279 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "73bbd85f92bf3017ceda8b93", "attempt_id": "3d7da555db3f", "run_group_id": "E1_core:B6|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5f903477abec1bb5d55c3fdb62f0e7cdaa6e271a6ce76c4c24f2aed85f54972d", "git_commit": null, "timestamp_utc": "2026-10-30T08:15:54.319962Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 6660387848}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 1833, "keep": 458, "window_tokens": 45, "compress_ms": 237.40212502889335}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 45, "message_tokens": 1833, "message_utf8_bytes": 7797, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539987, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 255.0340419402346, "doc_prefill_ms": 755.7172500528395, "compress_ms": 239.0654580667615, "serialize_ms": 15.727957943454385, "load_ms": 1.3509170385077596, "receiver_prefill_ms": 0.0, "query_prefill_ms": 775.9203750174493, "ttft_ms": 775.9203750174493, "decode_ms": 2776.375083019957}, "total_wall_ms": 3810.6947500491515, "ttft_ms": 775.9203750174493, "input_usage": {"receiver_prefix_tokens": 1833, "dense_cache_bytes": 210223104, "query_tokens": 45}, "output_usage": {"output_tokens": 95}, "provider_cached_usage": null, "process_memory": 4607213568, "backend_memory": {"mlx_active_bytes": 6782727176, "mlx_peak_bytes": 6846201008, "mlx_cache_bytes": 13776941673, "process_rss_bytes": 4607213568}, "peak_prefill_memory": 7114248584, "peak_decode_memory": 6846201008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'Brasil' and r['shipped_days'] > 0 and r['shipped_days'] <= 30 and r['units'] >= 3:\n total += r['units'] * (r['price'] - r['price_tax']) / 100\n return round(total, 1)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cbc5f4cdd11689900f722fe2822fc2a4a031a0cc67275e5a2436979af1406516", "output_hash": "9634503ef64bad26ab9c39f04ebe241d55fc598b541570c1090e88839a2a9778"} | ||
| 13280 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "bed146b144b2aae79fc28597", "attempt_id": "184a0271c61a", "run_group_id": "E1_core:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5f903477abec1bb5d55c3fdb62f0e7cdaa6e271a6ce76c4c24f2aed85f54972d", "git_commit": null, "timestamp_utc": "2026-10-30T08:15:58.187694Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 6660387848}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1833, "keep": 458, "window_tokens": 45, "compress_ms": 215.65874991938472, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 45, "message_tokens": 1833, "message_utf8_bytes": 7797, "cache_tensor_bytes": 27905024, "serialized_payload_bytes": 27931808, "side_information_bytes": 26784, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 240.00837502535433, "doc_prefill_ms": 755.7172500528395, "compress_ms": 227.48991602566093, "serialize_ms": 11.965167010203004, "load_ms": 2.515166997909546, "receiver_prefill_ms": 0.0, "query_prefill_ms": 80.02966595813632, "ttft_ms": 80.02966595813632, "decode_ms": 2747.8094580583274}, "total_wall_ms": 3072.6914999540895, "ttft_ms": 80.02966595813632, "input_usage": {"receiver_prefix_tokens": 1833, "dense_cache_bytes": 210223104, "query_tokens": 45}, "output_usage": {"output_tokens": 87}, "provider_cached_usage": null, "process_memory": 4635295744, "backend_memory": {"mlx_active_bytes": 6726884232, "mlx_peak_bytes": 6801893764, "mlx_cache_bytes": 14017897833, "process_rss_bytes": 4635295744}, "peak_prefill_memory": 7114248584, "peak_decode_memory": 6801893764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'Nordic' and r['shipped_days'] > 0 and r['units'] >= 3:\n total += r['units'] * (r['price'] - r['price'] * 0.05)\n return round(total, 1)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8917f1ddbd32af3864d926b03ec5386344e9aee78fcfab547010d24fc7396973", "output_hash": "ac4952f97dcca3f9355ebcb56c3f776365130c6b0263709fda5d0302bf9e472e"} | 13280 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "bed146b144b2aae79fc28597", "attempt_id": "184a0271c61a", "run_group_id": "E1_core:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5f903477abec1bb5d55c3fdb62f0e7cdaa6e271a6ce76c4c24f2aed85f54972d", "git_commit": null, "timestamp_utc": "2026-10-30T08:15:58.187694Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 6660387848}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1833, "keep": 458, "window_tokens": 45, "compress_ms": 215.65874991938472, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 45, "message_tokens": 1833, "message_utf8_bytes": 7797, "cache_tensor_bytes": 27905024, "serialized_payload_bytes": 27931808, "side_information_bytes": 26784, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 240.00837502535433, "doc_prefill_ms": 755.7172500528395, "compress_ms": 227.48991602566093, "serialize_ms": 11.965167010203004, "load_ms": 2.515166997909546, "receiver_prefill_ms": 0.0, "query_prefill_ms": 80.02966595813632, "ttft_ms": 80.02966595813632, "decode_ms": 2747.8094580583274}, "total_wall_ms": 3072.6914999540895, "ttft_ms": 80.02966595813632, "input_usage": {"receiver_prefix_tokens": 1833, "dense_cache_bytes": 210223104, "query_tokens": 45}, "output_usage": {"output_tokens": 87}, "provider_cached_usage": null, "process_memory": 4635295744, "backend_memory": {"mlx_active_bytes": 6726884232, "mlx_peak_bytes": 6801893764, "mlx_cache_bytes": 14017897833, "process_rss_bytes": 4635295744}, "peak_prefill_memory": 7114248584, "peak_decode_memory": 6801893764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'Nordic' and r['shipped_days'] > 0 and r['units'] >= 3:\n total += r['units'] * (r['price'] - r['price'] * 0.05)\n return round(total, 1)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8917f1ddbd32af3864d926b03ec5386344e9aee78fcfab547010d24fc7396973", "output_hash": "ac4952f97dcca3f9355ebcb56c3f776365130c6b0263709fda5d0302bf9e472e"} | ||
| 13281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e693c2a0f8067f34fe7c153b", "attempt_id": "fddc12edd77b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:16.091202Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425501000}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29854227405247813, "origin_tokens": 1715, "compressed_tokens": 622, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 720, "message_tokens": 622, "message_utf8_bytes": 2148, "cache_tensor_bytes": null, "serialized_payload_bytes": 2148, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2021.651333081536, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.24825007468462, "ttft_ms": 14.05166694894433, "decode_ms": 108.22170891333371}, "total_wall_ms": 217.37012499943376, "ttft_ms": 14.05166694894433, "input_usage": {"receiver_prompt_tokens": 720}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9828892672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927572312, "mlx_cache_bytes": 518107816, "process_rss_bytes": 9828892672}, "peak_prefill_memory": null, "peak_decode_memory": 6927572312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZL-78K-5065", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2b088774b4fab3483bb5bf185dc51a3428d262ac8df4af84d1932ad2c6c28590", "output_hash": "2a568d613468fe9e25fd3ab03aa2744ae45702a47a3665ea5aa63251d8bc749c"} | ||||
| 13282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "6ab0d61b023977a3aab86d0c", "attempt_id": "f1b3ef052f28", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:16.331245Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29854227405247813, "origin_tokens": 1715, "compressed_tokens": 622, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 725, "message_tokens": 622, "message_utf8_bytes": 2148, "cache_tensor_bytes": null, "serialized_payload_bytes": 2148, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2021.651333081536, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.62362489383668, "ttft_ms": 13.380417018197477, "decode_ms": 200.93450008425862}, "total_wall_ms": 297.28458309546113, "ttft_ms": 13.380417018197477, "input_usage": {"receiver_prompt_tokens": 725}, "output_usage": {"output_tokens": 15}, "provider_cached_usage": null, "process_memory": 9829154816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930562984, "mlx_cache_bytes": 950091256, "process_rss_bytes": 9829154816}, "peak_prefill_memory": null, "peak_decode_memory": 6930562984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wendra-11, Lot 409-H, Senneterre.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.25}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2b088774b4fab3483bb5bf185dc51a3428d262ac8df4af84d1932ad2c6c28590", "output_hash": "b64a2624a8239548dca756e390c89e0dbb0116a880ce2ef82839838aae5cb6d6"} | ||||
| 13283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "05ecf4710ef1ee8f643251a7", "attempt_id": "f90017ee15f8", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:16.650544Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29854227405247813, "origin_tokens": 1715, "compressed_tokens": 622, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 724, "message_tokens": 622, "message_utf8_bytes": 2148, "cache_tensor_bytes": null, "serialized_payload_bytes": 2148, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2021.651333081536, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.32379199378192, "ttft_ms": 13.422250049188733, "decode_ms": 66.910499939695}, "total_wall_ms": 162.95937495306134, "ttft_ms": 13.422250049188733, "input_usage": {"receiver_prompt_tokens": 724}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9829171200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930562984, "mlx_cache_bytes": 950091256, "process_rss_bytes": 9829171200}, "peak_prefill_memory": null, "peak_decode_memory": 6930562984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "53. 8485", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2b088774b4fab3483bb5bf185dc51a3428d262ac8df4af84d1932ad2c6c28590", "output_hash": "b6a830c876988e318c117bbe98ba0308462152115e9e345542ef4f0111fde741"} | ||||
| 13284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "b90cf31091d58cc6c352621c", "attempt_id": "46b9a28c6dcf", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:16.835584Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29854227405247813, "origin_tokens": 1715, "compressed_tokens": 622, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 722, "message_tokens": 622, "message_utf8_bytes": 2148, "cache_tensor_bytes": null, "serialized_payload_bytes": 2148, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2021.651333081536, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.60204098001122, "ttft_ms": 13.43433407600969, "decode_ms": 93.45495898742229}, "total_wall_ms": 188.7822919525206, "ttft_ms": 13.43433407600969, "input_usage": {"receiver_prompt_tokens": 722}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9829171200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6906281884, "mlx_cache_bytes": 1081540088, "process_rss_bytes": 9829171200}, "peak_prefill_memory": null, "peak_decode_memory": 6906281884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lorcan Okonkwo", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2b088774b4fab3483bb5bf185dc51a3428d262ac8df4af84d1932ad2c6c28590", "output_hash": "0899b5427048f8ade3a2c73afe103e6432ff382fe37cae3efa13bf39f3ca8326"} | ||||
| 13285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "98034bd4bd3d766b537260fc", "attempt_id": "c03001396ee5", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:17.045634Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29854227405247813, "origin_tokens": 1715, "compressed_tokens": 622, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 729, "message_tokens": 622, "message_utf8_bytes": 2148, "cache_tensor_bytes": null, "serialized_payload_bytes": 2148, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2021.651333081536, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.3810839317739, "ttft_ms": 13.53300001937896, "decode_ms": 67.80225003603846}, "total_wall_ms": 164.08870904706419, "ttft_ms": 13.53300001937896, "input_usage": {"receiver_prompt_tokens": 729}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9829203968, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6932381624, "mlx_cache_bytes": 1488570712, "process_rss_bytes": 9829203968}, "peak_prefill_memory": null, "peak_decode_memory": 6932381624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,358,405", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2b088774b4fab3483bb5bf185dc51a3428d262ac8df4af84d1932ad2c6c28590", "output_hash": "0cdd29b7d6e8daeeac8d4b1ad42aae1dd4c08db99789b82ac0f8f9b5bb149685"} | ||||
| 13286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "605c22f78d8ca17ec56afe0a", "attempt_id": "7fad51d65edc", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:17.664264Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09128186842574434, "origin_tokens": 5609, "compressed_tokens": 595, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 693, "message_tokens": 595, "message_utf8_bytes": 3080, "cache_tensor_bytes": null, "serialized_payload_bytes": 3080, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 428.2587090274319, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.21866697911173, "ttft_ms": 13.565208064392209, "decode_ms": 67.14649999048561}, "total_wall_ms": 163.3261670358479, "ttft_ms": 13.565208064392209, "input_usage": {"receiver_prompt_tokens": 693}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9831825408, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6912016168, "mlx_cache_bytes": 502105128, "process_rss_bytes": 9831825408}, "peak_prefill_memory": null, "peak_decode_memory": 6912016168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "53e8f3e5d23af373057d54cfb7eb07dab60c36bdc80bc577e5159b51478ddd19", "output_hash": "3123ff87d1ad9b263e28f2fddd4604886e24c865be647de72d7f2b49c4adf9e4"} | ||||
| 13287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "50af456617f12dfe766bbe43", "attempt_id": "4ad249c86321", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:17.855527Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09128186842574434, "origin_tokens": 5609, "compressed_tokens": 595, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 699, "message_tokens": 595, "message_utf8_bytes": 3080, "cache_tensor_bytes": null, "serialized_payload_bytes": 3080, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 428.2587090274319, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.91945892758667, "ttft_ms": 13.558999984525144, "decode_ms": 136.006208951585}, "total_wall_ms": 232.87962505128235, "ttft_ms": 13.558999984525144, "input_usage": {"receiver_prompt_tokens": 699}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9831890944, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6915391296, "mlx_cache_bytes": 918490896, "process_rss_bytes": 9831890944}, "peak_prefill_memory": null, "peak_decode_memory": 6915391296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 136-T, Val-d'Or.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "53e8f3e5d23af373057d54cfb7eb07dab60c36bdc80bc577e5159b51478ddd19", "output_hash": "5f0de62750d455586d1f0186109d27f65fbad08e214a81a62a809ae08099760e"} | ||||
| 13288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9d14b2cf784bbdf8dcb64f75", "attempt_id": "6ece51b460b2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:18.115807Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09128186842574434, "origin_tokens": 5609, "compressed_tokens": 595, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 698, "message_tokens": 595, "message_utf8_bytes": 3080, "cache_tensor_bytes": null, "serialized_payload_bytes": 3080, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 428.2587090274319, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.34458307176828, "ttft_ms": 13.529708026908338, "decode_ms": 13.409332954324782}, "total_wall_ms": 109.71012490335852, "ttft_ms": 13.529708026908338, "input_usage": {"receiver_prompt_tokens": 698}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9831907328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6915391296, "mlx_cache_bytes": 918490896, "process_rss_bytes": 9831907328}, "peak_prefill_memory": null, "peak_decode_memory": 6915391296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "53e8f3e5d23af373057d54cfb7eb07dab60c36bdc80bc577e5159b51478ddd19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9eceb89cf5082e75d42b9545", "attempt_id": "666beb731aed", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:18.253483Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09128186842574434, "origin_tokens": 5609, "compressed_tokens": 595, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 694, "message_tokens": 595, "message_utf8_bytes": 3080, "cache_tensor_bytes": null, "serialized_payload_bytes": 3080, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 428.2587090274319, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.72704197932035, "ttft_ms": 13.460957910865545, "decode_ms": 40.41708307340741}, "total_wall_ms": 136.9502500165254, "ttft_ms": 13.460957910865545, "input_usage": {"receiver_prompt_tokens": 694}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9831923712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6912393024, "mlx_cache_bytes": 1122963216, "process_rss_bytes": 9831923712}, "peak_prefill_memory": null, "peak_decode_memory": 6912393024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "53e8f3e5d23af373057d54cfb7eb07dab60c36bdc80bc577e5159b51478ddd19", "output_hash": "8fa68c7f01cff2cf9478768f28ec2ef832ba887f090823b25abbadc032d4ebce"} | ||||
| 13290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e7de4a26a9a8c9f496995df0", "attempt_id": "047eeb8e7f35", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:18.418418Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09128186842574434, "origin_tokens": 5609, "compressed_tokens": 595, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 704, "message_tokens": 595, "message_utf8_bytes": 3080, "cache_tensor_bytes": null, "serialized_payload_bytes": 3080, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 428.2587090274319, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.83562499471009, "ttft_ms": 13.709292048588395, "decode_ms": 14.347999938763678}, "total_wall_ms": 111.34775006212294, "ttft_ms": 13.709292048588395, "input_usage": {"receiver_prompt_tokens": 704}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9831923712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6918291284, "mlx_cache_bytes": 1516378636, "process_rss_bytes": 9831923712}, "peak_prefill_memory": null, "peak_decode_memory": 6918291284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "53e8f3e5d23af373057d54cfb7eb07dab60c36bdc80bc577e5159b51478ddd19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7fcd4596e51f6e27e5f295dc", "attempt_id": "d8090479493f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:19.326589Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047926612374801086, "origin_tokens": 10683, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 641, "message_tokens": 543, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.0792500935495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.37445901148021, "ttft_ms": 14.16324998717755, "decode_ms": 13.72533303219825}, "total_wall_ms": 106.66808299720287, "ttft_ms": 14.16324998717755, "input_usage": {"receiver_prompt_tokens": 641}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836396544, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6881377880, "mlx_cache_bytes": 470614872, "process_rss_bytes": 9836396544}, "peak_prefill_memory": null, "peak_decode_memory": 6881377880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "dd0973fbb70f6df409f5bddccc13f27efdc4008501ac5b81c6915723f28b5e32", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0693dd09f5ebb18189ee11ea", "attempt_id": "4fc94383b03f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:19.468329Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047926612374801086, "origin_tokens": 10683, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 649, "message_tokens": 543, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.0792500935495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.79649999085814, "ttft_ms": 14.618832967244089, "decode_ms": 14.192749978974462}, "total_wall_ms": 108.97004196885973, "ttft_ms": 14.618832967244089, "input_usage": {"receiver_prompt_tokens": 649}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836494848, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6886014584, "mlx_cache_bytes": 856804728, "process_rss_bytes": 9836494848}, "peak_prefill_memory": null, "peak_decode_memory": 6886014584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "dd0973fbb70f6df409f5bddccc13f27efdc4008501ac5b81c6915723f28b5e32", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "dd0a3e2af6e404dc22c926d6", "attempt_id": "46bc2ec397b0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:19.611597Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047926612374801086, "origin_tokens": 10683, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 648, "message_tokens": 543, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.0792500935495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.71583302039653, "ttft_ms": 13.85804102756083, "decode_ms": 14.070832985453308}, "total_wall_ms": 108.04883297532797, "ttft_ms": 13.85804102756083, "input_usage": {"receiver_prompt_tokens": 648}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836544000, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6886014584, "mlx_cache_bytes": 856804728, "process_rss_bytes": 9836544000}, "peak_prefill_memory": null, "peak_decode_memory": 6886014584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "dd0973fbb70f6df409f5bddccc13f27efdc4008501ac5b81c6915723f28b5e32", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "74f5483eb840b87c95033508", "attempt_id": "cc88581024fd", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:19.754778Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047926612374801086, "origin_tokens": 10683, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 642, "message_tokens": 543, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.0792500935495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.90075002796948, "ttft_ms": 14.335667015984654, "decode_ms": 13.735500047914684}, "total_wall_ms": 108.29170898068696, "ttft_ms": 14.335667015984654, "input_usage": {"receiver_prompt_tokens": 642}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836544000, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6882754168, "mlx_cache_bytes": 1215729016, "process_rss_bytes": 9836544000}, "peak_prefill_memory": null, "peak_decode_memory": 6882754168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "dd0973fbb70f6df409f5bddccc13f27efdc4008501ac5b81c6915723f28b5e32", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "70d9495af2eb6f400ba5104c", "attempt_id": "9e70072bfb75", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:19.899888Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047926612374801086, "origin_tokens": 10683, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 653, "message_tokens": 543, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.0792500935495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.0116669377312, "ttft_ms": 13.695917092263699, "decode_ms": 13.3534170454368}, "total_wall_ms": 107.36233298666775, "ttft_ms": 13.695917092263699, "input_usage": {"receiver_prompt_tokens": 653}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836560384, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6888832648, "mlx_cache_bytes": 1604802472, "process_rss_bytes": 9836560384}, "peak_prefill_memory": null, "peak_decode_memory": 6888832648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "dd0973fbb70f6df409f5bddccc13f27efdc4008501ac5b81c6915723f28b5e32", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "039ed125b8e59d05e87a148e", "attempt_id": "3401834bbe22", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:20.177592Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29732868757259, "origin_tokens": 1722, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 712, "message_tokens": 613, "message_utf8_bytes": 2275, "cache_tensor_bytes": null, "serialized_payload_bytes": 2275, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.26675004605204, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.32204203866422, "ttft_ms": 13.604249921627343, "decode_ms": 93.73520803637803}, "total_wall_ms": 189.96008404064924, "ttft_ms": 13.604249921627343, "input_usage": {"receiver_prompt_tokens": 712}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9836625920, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922927988, "mlx_cache_bytes": 513328244, "process_rss_bytes": 9836625920}, "peak_prefill_memory": null, "peak_decode_memory": 6922927988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GR-79S-5839", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "18a3ac2b35a8e6904db45dcf919ff1c109f97041ccf5c1e3dac0c1d25409bbbb", "output_hash": "720cc40cd69e85e9728f6bea00b17a95ca07eee643e143a131840763958303cd"} | ||||
| 13297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "a2c41c0a08ea1e75fada501a", "attempt_id": "ac9f2b7e542d", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:20.389340Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29732868757259, "origin_tokens": 1722, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 716, "message_tokens": 613, "message_utf8_bytes": 2275, "cache_tensor_bytes": null, "serialized_payload_bytes": 2275, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.26675004605204, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.43654104787856, "ttft_ms": 13.545499998144805, "decode_ms": 133.69549997150898}, "total_wall_ms": 229.93883304297924, "ttft_ms": 13.545499998144805, "input_usage": {"receiver_prompt_tokens": 716}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9836642304, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925746052, "mlx_cache_bytes": 940347296, "process_rss_bytes": 9836642304}, "peak_prefill_memory": null, "peak_decode_memory": 6925746052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 344-B, Brigam-3.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "18a3ac2b35a8e6904db45dcf919ff1c109f97041ccf5c1e3dac0c1d25409bbbb", "output_hash": "0c125cfd8a40ccd96622211c8fcd5fe0c12dc4afe88880a82b2142144b87c9e3"} | ||||
| 13298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "330dbe642eb5f98691b1dd22", "attempt_id": "60df7093855f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:20.640482Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29732868757259, "origin_tokens": 1722, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 716, "message_tokens": 613, "message_utf8_bytes": 2275, "cache_tensor_bytes": null, "serialized_payload_bytes": 2275, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.26675004605204, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.5702080251649, "ttft_ms": 13.477666885592043, "decode_ms": 13.66570801474154}, "total_wall_ms": 108.98645897395909, "ttft_ms": 13.477666885592043, "input_usage": {"receiver_prompt_tokens": 716}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836642304, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925746052, "mlx_cache_bytes": 940347296, "process_rss_bytes": 9836642304}, "peak_prefill_memory": null, "peak_decode_memory": 6925746052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "18a3ac2b35a8e6904db45dcf919ff1c109f97041ccf5c1e3dac0c1d25409bbbb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "dad77a2764ea90729fc54ba0", "attempt_id": "fdc5d21f147e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:20.770739Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29732868757259, "origin_tokens": 1722, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 711, "message_tokens": 613, "message_utf8_bytes": 2275, "cache_tensor_bytes": null, "serialized_payload_bytes": 2275, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.26675004605204, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.16004196926951, "ttft_ms": 13.55504197999835, "decode_ms": 66.9077499769628}, "total_wall_ms": 162.9088749177754, "ttft_ms": 13.55504197999835, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9836642304, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922927988, "mlx_cache_bytes": 940347296, "process_rss_bytes": 9836642304}, "peak_prefill_memory": null, "peak_decode_memory": 6922927988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Aurelio Obuya", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "18a3ac2b35a8e6904db45dcf919ff1c109f97041ccf5c1e3dac0c1d25409bbbb", "output_hash": "f1ce4925037312b15b000d239b3674716a85608f05fe592eb101242927ff1f34"} | ||||
| 13300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "35e8631c32a66947dd3475ce", "attempt_id": "3261fc1bcbf9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:20.954641Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29732868757259, "origin_tokens": 1722, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 720, "message_tokens": 613, "message_utf8_bytes": 2275, "cache_tensor_bytes": null, "serialized_payload_bytes": 2275, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.26675004605204, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12020895350724, "ttft_ms": 13.62887502182275, "decode_ms": 13.435082975775003}, "total_wall_ms": 109.33791601564735, "ttft_ms": 13.62887502182275, "input_usage": {"receiver_prompt_tokens": 720}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836642304, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927564692, "mlx_cache_bytes": 1342708444, "process_rss_bytes": 9836642304}, "peak_prefill_memory": null, "peak_decode_memory": 6927564692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "18a3ac2b35a8e6904db45dcf919ff1c109f97041ccf5c1e3dac0c1d25409bbbb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "b004f341b2d986156d66c2cc", "attempt_id": "941658e7dc53", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:21.497337Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09063551070986015, "origin_tokens": 5649, "compressed_tokens": 606, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 705, "message_tokens": 606, "message_utf8_bytes": 2961, "cache_tensor_bytes": null, "serialized_payload_bytes": 2961, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 409.0547499945387, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.09295794181526, "ttft_ms": 13.505958952009678, "decode_ms": 13.382583972997963}, "total_wall_ms": 108.27175003942102, "ttft_ms": 13.505958952009678, "input_usage": {"receiver_prompt_tokens": 705}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836691456, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6918471512, "mlx_cache_bytes": 508757080, "process_rss_bytes": 9836691456}, "peak_prefill_memory": null, "peak_decode_memory": 6918471512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "33baf3d7325d6ec03cde3459fca49c82c3b55983c4d0e102a0693e318c073ad0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "56dd5510ee8b56dfe1103e2a", "attempt_id": "5503db0ad1a4", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:21.632820Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09063551070986015, "origin_tokens": 5649, "compressed_tokens": 606, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 709, "message_tokens": 606, "message_utf8_bytes": 2961, "cache_tensor_bytes": null, "serialized_payload_bytes": 2961, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 409.0547499945387, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.36358298361301, "ttft_ms": 13.633999973535538, "decode_ms": 13.37166700977832}, "total_wall_ms": 109.7369579365477, "ttft_ms": 13.633999973535538, "input_usage": {"receiver_prompt_tokens": 709}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836658688, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921289576, "mlx_cache_bytes": 931204968, "process_rss_bytes": 9836658688}, "peak_prefill_memory": null, "peak_decode_memory": 6921289576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "33baf3d7325d6ec03cde3459fca49c82c3b55983c4d0e102a0693e318c073ad0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d8dcca0ba4203b70bf7c9fb8", "attempt_id": "9a009c2ef02c", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:21.769806Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09063551070986015, "origin_tokens": 5649, "compressed_tokens": 606, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 709, "message_tokens": 606, "message_utf8_bytes": 2961, "cache_tensor_bytes": null, "serialized_payload_bytes": 2961, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 409.0547499945387, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12391701433808, "ttft_ms": 13.566958950832486, "decode_ms": 13.396875001490116}, "total_wall_ms": 109.33395894244313, "ttft_ms": 13.566958950832486, "input_usage": {"receiver_prompt_tokens": 709}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9836658688, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921289576, "mlx_cache_bytes": 931204968, "process_rss_bytes": 9836658688}, "peak_prefill_memory": null, "peak_decode_memory": 6921289576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "33baf3d7325d6ec03cde3459fca49c82c3b55983c4d0e102a0693e318c073ad0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "150afc3ea84b785010ef3412", "attempt_id": "1b12feb47089", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:21.905981Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09063551070986015, "origin_tokens": 5649, "compressed_tokens": 606, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 706, "message_tokens": 606, "message_utf8_bytes": 2961, "cache_tensor_bytes": null, "serialized_payload_bytes": 2961, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 409.0547499945387, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.9357080142945, "ttft_ms": 13.638250064104795, "decode_ms": 53.30920801497996}, "total_wall_ms": 149.13216698914766, "ttft_ms": 13.638250064104795, "input_usage": {"receiver_prompt_tokens": 706}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9836658688, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6955450216, "mlx_cache_bytes": 1113231208, "process_rss_bytes": 9836658688}, "peak_prefill_memory": null, "peak_decode_memory": 6955450216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Mäkelä", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "33baf3d7325d6ec03cde3459fca49c82c3b55983c4d0e102a0693e318c073ad0", "output_hash": "4f2c406c72d386d787e1d5d7b4a55ecd1815ee6e49d88f208969fc2241b58aa2"} | ||||
| 13305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2bfd62f2b0bfbb691a981787", "attempt_id": "28cb45c5a8c2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:22.081496Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09063551070986015, "origin_tokens": 5649, "compressed_tokens": 606, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 711, "message_tokens": 606, "message_utf8_bytes": 2961, "cache_tensor_bytes": null, "serialized_payload_bytes": 2961, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 409.0547499945387, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.02945797145367, "ttft_ms": 13.52983305696398, "decode_ms": 40.32929195091128}, "total_wall_ms": 136.1703749280423, "ttft_ms": 13.52983305696398, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9836658688, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 1510726272, "process_rss_bytes": 9836658688}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "USD. revised", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "33baf3d7325d6ec03cde3459fca49c82c3b55983c4d0e102a0693e318c073ad0", "output_hash": "71cee772fbcfa578116ceb4d2bf5bf2abd0731459fb1c1abc555c643e9a7f1b2"} | ||||
| 13306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9db43ad67c7d089cf78a5de4", "attempt_id": "ca01365eff0b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.009202Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04748655166017436, "origin_tokens": 10782, "compressed_tokens": 522, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 619, "message_tokens": 522, "message_utf8_bytes": 2559, "cache_tensor_bytes": null, "serialized_payload_bytes": 2559, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.5764999752864, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.88595799077302, "ttft_ms": 13.516874983906746, "decode_ms": 13.315332937054336}, "total_wall_ms": 103.00029208883643, "ttft_ms": 13.516874983906746, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837002752, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6869024256, "mlx_cache_bytes": 457900800, "process_rss_bytes": 9837002752}, "peak_prefill_memory": null, "peak_decode_memory": 6869024256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cca99e503f310df0a1b131a1eb87dc6496a54df89a6b91c41dafbf6d397932e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d2f90d8a5399cb3e784f30f1", "attempt_id": "3f8787e347ec", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.146919Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04748655166017436, "origin_tokens": 10782, "compressed_tokens": 522, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 627, "message_tokens": 522, "message_utf8_bytes": 2559, "cache_tensor_bytes": null, "serialized_payload_bytes": 2559, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.5764999752864, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.17145795281976, "ttft_ms": 13.402958982624114, "decode_ms": 13.350917026400566}, "total_wall_ms": 103.29599992837757, "ttft_ms": 13.402958982624114, "input_usage": {"receiver_prompt_tokens": 627}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837035520, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660960, "mlx_cache_bytes": 831376584, "process_rss_bytes": 9837035520}, "peak_prefill_memory": null, "peak_decode_memory": 6873660960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cca99e503f310df0a1b131a1eb87dc6496a54df89a6b91c41dafbf6d397932e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ce5380e61d48a6de0b22a7c5", "attempt_id": "1efb31f6d0da", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.284010Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04748655166017436, "origin_tokens": 10782, "compressed_tokens": 522, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 626, "message_tokens": 522, "message_utf8_bytes": 2559, "cache_tensor_bytes": null, "serialized_payload_bytes": 2559, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.5764999752864, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.75908403284848, "ttft_ms": 13.608583016321063, "decode_ms": 13.437416055239737}, "total_wall_ms": 102.95958293136209, "ttft_ms": 13.608583016321063, "input_usage": {"receiver_prompt_tokens": 626}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837035520, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660960, "mlx_cache_bytes": 831376584, "process_rss_bytes": 9837035520}, "peak_prefill_memory": null, "peak_decode_memory": 6873660960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cca99e503f310df0a1b131a1eb87dc6496a54df89a6b91c41dafbf6d397932e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "be35247ce47acf316ef1b413", "attempt_id": "d4eb5d26eaa6", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.420812Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04748655166017436, "origin_tokens": 10782, "compressed_tokens": 522, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 621, "message_tokens": 522, "message_utf8_bytes": 2559, "cache_tensor_bytes": null, "serialized_payload_bytes": 2559, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.5764999752864, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.89741596207023, "ttft_ms": 13.512792065739632, "decode_ms": 27.130375034175813}, "total_wall_ms": 119.67762489803135, "ttft_ms": 13.512792065739632, "input_usage": {"receiver_prompt_tokens": 621}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9837035520, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6870285856, "mlx_cache_bytes": 1178373320, "process_rss_bytes": 9837035520}, "peak_prefill_memory": null, "peak_decode_memory": 6870285856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cca99e503f310df0a1b131a1eb87dc6496a54df89a6b91c41dafbf6d397932e6", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 13310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7b4b46636fc71ed92a64df0e", "attempt_id": "62a7eff9ff65", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.574704Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04748655166017436, "origin_tokens": 10782, "compressed_tokens": 522, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 631, "message_tokens": 522, "message_utf8_bytes": 2559, "cache_tensor_bytes": null, "serialized_payload_bytes": 2559, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.5764999752864, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.21879195701331, "ttft_ms": 13.592291041277349, "decode_ms": 13.281708001159132}, "total_wall_ms": 103.27895905356854, "ttft_ms": 13.592291041277349, "input_usage": {"receiver_prompt_tokens": 631}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837035520, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876184112, "mlx_cache_bytes": 1531139744, "process_rss_bytes": 9837035520}, "peak_prefill_memory": null, "peak_decode_memory": 6876184112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cca99e503f310df0a1b131a1eb87dc6496a54df89a6b91c41dafbf6d397932e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "a6d84e8f2040a20e94e0314a", "attempt_id": "e6a15fd85355", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:23.846426Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29819452533488644, "origin_tokens": 1717, "compressed_tokens": 599, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 697, "message_tokens": 599, "message_utf8_bytes": 2267, "cache_tensor_bytes": null, "serialized_payload_bytes": 2267, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.40666694380343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.37258398346603, "ttft_ms": 13.665708946064115, "decode_ms": 93.69083296041936}, "total_wall_ms": 189.98687504790723, "ttft_ms": 13.665708946064115, "input_usage": {"receiver_prompt_tokens": 697}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9837068288, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 503989304, "process_rss_bytes": 9837068288}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XM-76Q-2958", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d37753651cdfb57ade7647f321fc8746c037f3445cf69c954a8d16d3864b5432", "output_hash": "cf42691eec772b9ec74d67643944de2e19e53724d7b772cef1e0f2d5ef3b4926"} | ||||
| 13312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "856e10087b4b2cee539d82c7", "attempt_id": "2ac23a7da3ea", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:24.058308Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29819452533488644, "origin_tokens": 1717, "compressed_tokens": 599, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 703, "message_tokens": 599, "message_utf8_bytes": 2267, "cache_tensor_bytes": null, "serialized_payload_bytes": 2267, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.40666694380343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.25337509065866, "ttft_ms": 13.436082983389497, "decode_ms": 120.62862503807992}, "total_wall_ms": 217.55254198797047, "ttft_ms": 13.436082983389497, "input_usage": {"receiver_prompt_tokens": 703}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9837084672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6917914448, "mlx_cache_bytes": 922963760, "process_rss_bytes": 9837084672}, "peak_prefill_memory": null, "peak_decode_memory": 6917914448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 412-V, La Tuque.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.888888888888889}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d37753651cdfb57ade7647f321fc8746c037f3445cf69c954a8d16d3864b5432", "output_hash": "8589a552e6e482abb94f41c9f8d0db6d30f130554531457467c17e51b1c3db40"} | ||||
| 13313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c37be386e86668f8570ce142", "attempt_id": "fca0493ed3ae", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:24.297831Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29819452533488644, "origin_tokens": 1717, "compressed_tokens": 599, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 702, "message_tokens": 599, "message_utf8_bytes": 2267, "cache_tensor_bytes": null, "serialized_payload_bytes": 2267, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.40666694380343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.47770895063877, "ttft_ms": 13.465958996675909, "decode_ms": 26.68424998410046}, "total_wall_ms": 121.8952089548111, "ttft_ms": 13.465958996675909, "input_usage": {"receiver_prompt_tokens": 702}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9837084672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6952353616, "mlx_cache_bytes": 966053680, "process_rss_bytes": 9837084672}, "peak_prefill_memory": null, "peak_decode_memory": 6952353616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d37753651cdfb57ade7647f321fc8746c037f3445cf69c954a8d16d3864b5432", "output_hash": "25602777cecc667d222cfeb509c62be1591a64d751c3142c1381dee13677a294"} | ||||
| 13314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "3373fc8d05122d8967101a79", "attempt_id": "03a723eb6019", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:24.440948Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29819452533488644, "origin_tokens": 1717, "compressed_tokens": 599, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 697, "message_tokens": 599, "message_utf8_bytes": 2267, "cache_tensor_bytes": null, "serialized_payload_bytes": 2267, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.40666694380343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.52091603167355, "ttft_ms": 13.448041980154812, "decode_ms": 79.8771670088172}, "total_wall_ms": 175.02349999267608, "ttft_ms": 13.448041980154812, "input_usage": {"receiver_prompt_tokens": 697}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9837084672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 966053680, "process_rss_bytes": 9837084672}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Baie-Comeau.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d37753651cdfb57ade7647f321fc8746c037f3445cf69c954a8d16d3864b5432", "output_hash": "1983764ed5eade23c262b4dc64006483a2ed1387c947c094372bb23627643740"} | ||||
| 13315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "beb9b77d49e6d23fe298c7bf", "attempt_id": "d3f0e1e54cf2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:24.636820Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29819452533488644, "origin_tokens": 1717, "compressed_tokens": 599, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 706, "message_tokens": 599, "message_utf8_bytes": 2267, "cache_tensor_bytes": null, "serialized_payload_bytes": 2267, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 131.40666694380343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.01883297786117, "ttft_ms": 13.520624954253435, "decode_ms": 40.04679201170802}, "total_wall_ms": 135.82333293743432, "ttft_ms": 13.520624954253435, "input_usage": {"receiver_prompt_tokens": 706}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9837084672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6919847772, "mlx_cache_bytes": 1387010612, "process_rss_bytes": 9837084672}, "peak_prefill_memory": null, "peak_decode_memory": 6919847772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,369", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d37753651cdfb57ade7647f321fc8746c037f3445cf69c954a8d16d3864b5432", "output_hash": "27f1cfb0e1eae007bb34269321afd51928fe82cc9e903b69fea2b27ee9acfed7"} | ||||
| 13316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "61338617f19c57e9888b4503", "attempt_id": "6e41a48f1c21", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:25.205061Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.090892952245695, "origin_tokens": 5633, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 710, "message_tokens": 611, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 407.9842499922961, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.26316592097282, "ttft_ms": 13.588458998128772, "decode_ms": 13.444832991808653}, "total_wall_ms": 109.66783307958394, "ttft_ms": 13.588458998128772, "input_usage": {"receiver_prompt_tokens": 710}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837084672, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921666412, "mlx_cache_bytes": 512033900, "process_rss_bytes": 9837084672}, "peak_prefill_memory": null, "peak_decode_memory": 6921666412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "47e3d8e12c10eee6a1c6173207537ddabaa3435d88b25b89ab810b284983ef89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ba5cf092e17645cdd4cfc555", "attempt_id": "ba7af663bf09", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:25.342161Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.090892952245695, "origin_tokens": 5633, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 715, "message_tokens": 611, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 407.9842499922961, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.52179105672985, "ttft_ms": 13.650167034938931, "decode_ms": 13.311666902154684}, "total_wall_ms": 109.75912492722273, "ttft_ms": 13.650167034938931, "input_usage": {"receiver_prompt_tokens": 715}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837101056, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924664704, "mlx_cache_bytes": 937955220, "process_rss_bytes": 9837101056}, "peak_prefill_memory": null, "peak_decode_memory": 6924664704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "47e3d8e12c10eee6a1c6173207537ddabaa3435d88b25b89ab810b284983ef89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e8b85a07ca5669a3e4684c1f", "attempt_id": "2c1b966e9660", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:25.478342Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.090892952245695, "origin_tokens": 5633, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 714, "message_tokens": 611, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 407.9842499922961, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.81312500871718, "ttft_ms": 13.47337500192225, "decode_ms": 13.439750066027045}, "total_wall_ms": 108.99958293884993, "ttft_ms": 13.47337500192225, "input_usage": {"receiver_prompt_tokens": 714}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837101056, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924664704, "mlx_cache_bytes": 937955220, "process_rss_bytes": 9837101056}, "peak_prefill_memory": null, "peak_decode_memory": 6924664704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "47e3d8e12c10eee6a1c6173207537ddabaa3435d88b25b89ab810b284983ef89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "f1823930455f93293faf970a", "attempt_id": "6d6c5df41c85", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:25.613821Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.090892952245695, "origin_tokens": 5633, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 710, "message_tokens": 611, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 407.9842499922961, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.76729194726795, "ttft_ms": 13.472500024363399, "decode_ms": 13.40845797676593}, "total_wall_ms": 108.89720800332725, "ttft_ms": 13.472500024363399, "input_usage": {"receiver_prompt_tokens": 710}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837101056, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921666412, "mlx_cache_bytes": 937955220, "process_rss_bytes": 9837101056}, "peak_prefill_memory": null, "peak_decode_memory": 6921666412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "47e3d8e12c10eee6a1c6173207537ddabaa3435d88b25b89ab810b284983ef89", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 13320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e620629976e52bc9b56fd6b5", "attempt_id": "441a24dca1f2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:25.749119Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.090892952245695, "origin_tokens": 5633, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 718, "message_tokens": 611, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 407.9842499922961, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.22354105580598, "ttft_ms": 13.476624968461692, "decode_ms": 13.359582982957363}, "total_wall_ms": 109.31908409111202, "ttft_ms": 13.476624968461692, "input_usage": {"receiver_prompt_tokens": 718}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837101056, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6926303116, "mlx_cache_bytes": 1339022024, "process_rss_bytes": 9837101056}, "peak_prefill_memory": null, "peak_decode_memory": 6926303116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "47e3d8e12c10eee6a1c6173207537ddabaa3435d88b25b89ab810b284983ef89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8e5bd76fa18e0f2fc2456ed0", "attempt_id": "9327eea20e70", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:26.689730Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04757480022300688, "origin_tokens": 10771, "compressed_tokens": 529, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 627, "message_tokens": 529, "message_utf8_bytes": 2644, "cache_tensor_bytes": null, "serialized_payload_bytes": 2644, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 801.106124999933, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.56787494104356, "ttft_ms": 13.49212508648634, "decode_ms": 53.819790948182344}, "total_wall_ms": 144.15887498762459, "ttft_ms": 13.49212508648634, "input_usage": {"receiver_prompt_tokens": 627}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9837330432, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660960, "mlx_cache_bytes": 462668576, "process_rss_bytes": 9837330432}, "peak_prefill_memory": null, "peak_decode_memory": 6873660960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f4ccf81eb999a26957f26f1004f241c85fa3c90fc3431b0519db286f45540676", "output_hash": "123b0852843e9939437f362f86da3c29910132ad9926dd4a6d2ec56cc7af472e"} | ||||
| 13322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "71af2edddc666df3f6c12cf3", "attempt_id": "90fe54a58e99", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:26.868716Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04757480022300688, "origin_tokens": 10771, "compressed_tokens": 529, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 632, "message_tokens": 529, "message_utf8_bytes": 2644, "cache_tensor_bytes": null, "serialized_payload_bytes": 2644, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 801.106124999933, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.44866704847664, "ttft_ms": 13.548833085224032, "decode_ms": 13.507624971680343}, "total_wall_ms": 103.72545896098018, "ttft_ms": 13.548833085224032, "input_usage": {"receiver_prompt_tokens": 632}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837346816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 815828220, "process_rss_bytes": 9837346816}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f4ccf81eb999a26957f26f1004f241c85fa3c90fc3431b0519db286f45540676", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "11b5d8e71b69ab1f117a3d84", "attempt_id": "1eaf90216b51", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.006247Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04757480022300688, "origin_tokens": 10771, "compressed_tokens": 529, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 632, "message_tokens": 529, "message_utf8_bytes": 2644, "cache_tensor_bytes": null, "serialized_payload_bytes": 2644, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 801.106124999933, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.44049993157387, "ttft_ms": 13.647667015902698, "decode_ms": 13.379666954278946}, "total_wall_ms": 103.63395803142339, "ttft_ms": 13.647667015902698, "input_usage": {"receiver_prompt_tokens": 632}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837346816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 815828220, "process_rss_bytes": 9837346816}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f4ccf81eb999a26957f26f1004f241c85fa3c90fc3431b0519db286f45540676", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "61814ea39ebc24e7542f2f62", "attempt_id": "9db798804f9e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.143269Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04757480022300688, "origin_tokens": 10771, "compressed_tokens": 529, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 628, "message_tokens": 529, "message_utf8_bytes": 2644, "cache_tensor_bytes": null, "serialized_payload_bytes": 2644, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 801.106124999933, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.25812496896833, "ttft_ms": 13.28083302360028, "decode_ms": 13.308333000168204}, "total_wall_ms": 103.17112505435944, "ttft_ms": 13.28083302360028, "input_usage": {"receiver_prompt_tokens": 628}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837346816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6906347060, "mlx_cache_bytes": 1039502588, "process_rss_bytes": 9837346816}, "peak_prefill_memory": null, "peak_decode_memory": 6906347060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f4ccf81eb999a26957f26f1004f241c85fa3c90fc3431b0519db286f45540676", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "5fbaf86b249e4aa3ec5f972f", "attempt_id": "ebc414117b3a", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.280504Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04757480022300688, "origin_tokens": 10771, "compressed_tokens": 529, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 636, "message_tokens": 529, "message_utf8_bytes": 2644, "cache_tensor_bytes": null, "serialized_payload_bytes": 2644, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 801.106124999933, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.23333297669888, "ttft_ms": 13.575250050053, "decode_ms": 13.594208052381873}, "total_wall_ms": 104.59416708908975, "ttft_ms": 13.575250050053, "input_usage": {"receiver_prompt_tokens": 636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837346816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879379012, "mlx_cache_bytes": 1418843880, "process_rss_bytes": 9837346816}, "peak_prefill_memory": null, "peak_decode_memory": 6879379012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f4ccf81eb999a26957f26f1004f241c85fa3c90fc3431b0519db286f45540676", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "06da8a1672751aa9ca757495", "attempt_id": "0c2da0af41ea", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.554281Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28926553672316385, "origin_tokens": 1770, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 687, "message_tokens": 588, "message_utf8_bytes": 2272, "cache_tensor_bytes": null, "serialized_payload_bytes": 2272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.705416996032, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.05258294381201, "ttft_ms": 13.896625023335218, "decode_ms": 13.431750005111098}, "total_wall_ms": 109.6271249698475, "ttft_ms": 13.896625023335218, "input_usage": {"receiver_prompt_tokens": 687}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837346816, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6908641040, "mlx_cache_bytes": 498631696, "process_rss_bytes": 9837346816}, "peak_prefill_memory": null, "peak_decode_memory": 6908641040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d8df937f8da5a696158e8a1446273786197c202fb86872d6fef677668be03b5f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c830e5b0b344c78b2757886b", "attempt_id": "c3ab40b2c9f2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.686264Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28926553672316385, "origin_tokens": 1770, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 692, "message_tokens": 588, "message_utf8_bytes": 2272, "cache_tensor_bytes": null, "serialized_payload_bytes": 2272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.705416996032, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12991601228714, "ttft_ms": 13.508333009667695, "decode_ms": 134.47612500749528}, "total_wall_ms": 230.38358404301107, "ttft_ms": 13.508333009667695, "input_usage": {"receiver_prompt_tokens": 692}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9837363200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6911835940, "mlx_cache_bytes": 911347420, "process_rss_bytes": 9837363200}, "peak_prefill_memory": null, "peak_decode_memory": 6911835940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 94-V, Mont-Laurier.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d8df937f8da5a696158e8a1446273786197c202fb86872d6fef677668be03b5f", "output_hash": "889eab3a8175f92017845cddf5aaa5f561db4019f6a97bbcaabc7f6a54974f33"} | ||||
| 13328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "5517d853a359e9ed2f9c6a1e", "attempt_id": "6de1b8aa96a7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:27.937898Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28926553672316385, "origin_tokens": 1770, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 691, "message_tokens": 588, "message_utf8_bytes": 2272, "cache_tensor_bytes": null, "serialized_payload_bytes": 2272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.705416996032, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12820901442319, "ttft_ms": 13.528999988920987, "decode_ms": 53.33645804785192}, "total_wall_ms": 149.2738330271095, "ttft_ms": 13.528999988920987, "input_usage": {"receiver_prompt_tokens": 691}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9837363200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6945750820, "mlx_cache_bytes": 953781980, "process_rss_bytes": 9837363200}, "peak_prefill_memory": null, "peak_decode_memory": 6945750820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "32.8676", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d8df937f8da5a696158e8a1446273786197c202fb86872d6fef677668be03b5f", "output_hash": "520ae1b2810b61f606b08593758796f82b0309e238b5baba5846523b2369e949"} | ||||
| 13329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "5329632c59db9847a6f4c7dc", "attempt_id": "d1fb3470f3ea", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:28.108413Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28926553672316385, "origin_tokens": 1770, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 686, "message_tokens": 588, "message_utf8_bytes": 2272, "cache_tensor_bytes": null, "serialized_payload_bytes": 2272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.705416996032, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.70362498983741, "ttft_ms": 13.473291997797787, "decode_ms": 107.45958401821554}, "total_wall_ms": 202.82500004395843, "ttft_ms": 13.473291997797787, "input_usage": {"receiver_prompt_tokens": 686}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9837363200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6942293776, "mlx_cache_bytes": 995888860, "process_rss_bytes": 9837363200}, "peak_prefill_memory": null, "peak_decode_memory": 6942293776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felker-16, no name.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d8df937f8da5a696158e8a1446273786197c202fb86872d6fef677668be03b5f", "output_hash": "503e4aecf7b42f59a70eba64e5160a8d367f15c8e3821cd96d36709f5418f4ee"} | ||||
| 13330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c4db781fb6d55dee37ad4b55", "attempt_id": "1a37bd8ed007", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:28.333051Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28926553672316385, "origin_tokens": 1770, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 695, "message_tokens": 588, "message_utf8_bytes": 2272, "cache_tensor_bytes": null, "serialized_payload_bytes": 2272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.705416996032, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.41087496187538, "ttft_ms": 13.381791999563575, "decode_ms": 40.59016704559326}, "total_wall_ms": 136.57358300406486, "ttft_ms": 13.381791999563575, "input_usage": {"receiver_prompt_tokens": 695}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9837363200, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913277744, "mlx_cache_bytes": 1384438196, "process_rss_bytes": 9837363200}, "peak_prefill_memory": null, "peak_decode_memory": 6913277744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,670", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d8df937f8da5a696158e8a1446273786197c202fb86872d6fef677668be03b5f", "output_hash": "ec6c6b600939a99921fa54f20e8307a794be9784727ffd460b61a3db8974f6e1"} | ||||
| 13331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2933aa7c9adf946215a394a2", "attempt_id": "e75c7e93a484", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:28.916636Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 601, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 700, "message_tokens": 601, "message_utf8_bytes": 2965, "cache_tensor_bytes": null, "serialized_payload_bytes": 2965, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 422.1863750135526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.55812497716397, "ttft_ms": 13.557457947172225, "decode_ms": 13.527875067666173}, "total_wall_ms": 110.01608392689377, "ttft_ms": 13.557457947172225, "input_usage": {"receiver_prompt_tokens": 700}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837412352, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916472644, "mlx_cache_bytes": 506676292, "process_rss_bytes": 9837412352}, "peak_prefill_memory": null, "peak_decode_memory": 6916472644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "15068589f08254b87e572335d18d1bb1d63baf3a17e7734857607e732254ab03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1648d20c65f6d95e54fbc5a4", "attempt_id": "baa300b28ace", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:29.054692Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 601, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 705, "message_tokens": 601, "message_utf8_bytes": 2965, "cache_tensor_bytes": null, "serialized_payload_bytes": 2965, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 422.1863750135526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.97195795178413, "ttft_ms": 13.368583051487803, "decode_ms": 13.531291973777115}, "total_wall_ms": 108.1840000115335, "ttft_ms": 13.368583051487803, "input_usage": {"receiver_prompt_tokens": 705}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837428736, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6918471512, "mlx_cache_bytes": 900288324, "process_rss_bytes": 9837428736}, "peak_prefill_memory": null, "peak_decode_memory": 6918471512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "15068589f08254b87e572335d18d1bb1d63baf3a17e7734857607e732254ab03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c775134c8b4f8bb37033ef28", "attempt_id": "5722955ab486", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:29.189359Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 601, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 704, "message_tokens": 601, "message_utf8_bytes": 2965, "cache_tensor_bytes": null, "serialized_payload_bytes": 2965, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 422.1863750135526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.49737503845245, "ttft_ms": 13.479875051416457, "decode_ms": 13.450167025439441}, "total_wall_ms": 109.65662496164441, "ttft_ms": 13.479875051416457, "input_usage": {"receiver_prompt_tokens": 704}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837428736, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6918471512, "mlx_cache_bytes": 900288324, "process_rss_bytes": 9837428736}, "peak_prefill_memory": null, "peak_decode_memory": 6918471512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "15068589f08254b87e572335d18d1bb1d63baf3a17e7734857607e732254ab03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "055c351f6aa50650f8cacc10", "attempt_id": "ec1465fa984f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:29.325930Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 601, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 699, "message_tokens": 601, "message_utf8_bytes": 2965, "cache_tensor_bytes": null, "serialized_payload_bytes": 2965, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 422.1863750135526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.71358304005116, "ttft_ms": 13.409083941951394, "decode_ms": 13.664041995070875}, "total_wall_ms": 109.01254194322973, "ttft_ms": 13.409083941951394, "input_usage": {"receiver_prompt_tokens": 699}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837428736, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6950780740, "mlx_cache_bytes": 943214404, "process_rss_bytes": 9837428736}, "peak_prefill_memory": null, "peak_decode_memory": 6950780740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "15068589f08254b87e572335d18d1bb1d63baf3a17e7734857607e732254ab03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "32c45e81d46b75020f497e26", "attempt_id": "172d8226cb9e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:29.461993Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 601, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 708, "message_tokens": 601, "message_utf8_bytes": 2965, "cache_tensor_bytes": null, "serialized_payload_bytes": 2965, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 422.1863750135526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.45224989857525, "ttft_ms": 13.403124990873039, "decode_ms": 13.626542058773339}, "total_wall_ms": 109.72304199822247, "ttft_ms": 13.403124990873039, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9837428736, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921109348, "mlx_cache_bytes": 1365465680, "process_rss_bytes": 9837428736}, "peak_prefill_memory": null, "peak_decode_memory": 6921109348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "15068589f08254b87e572335d18d1bb1d63baf3a17e7734857607e732254ab03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "abd1f87f688162ded6bafed0", "attempt_id": "69441c94420b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:30.361832Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047473342605470564, "origin_tokens": 10785, "compressed_tokens": 526, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 623, "message_tokens": 526, "message_utf8_bytes": 2633, "cache_tensor_bytes": null, "serialized_payload_bytes": 2633, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 759.6773330587894, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.44416701421142, "ttft_ms": 13.728290912695229, "decode_ms": 13.291124952957034}, "total_wall_ms": 103.68558403570205, "ttft_ms": 13.728290912695229, "input_usage": {"receiver_prompt_tokens": 623}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839722496, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6871547408, "mlx_cache_bytes": 460489488, "process_rss_bytes": 9839722496}, "peak_prefill_memory": null, "peak_decode_memory": 6871547408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9b3e78275d12332cd4f2a7b43eb416eb415b9511b418eb26fa5f5164556f6590", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "40ffcb3653b3349371d73f97", "attempt_id": "62a012b4b0a4", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:30.500696Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047473342605470564, "origin_tokens": 10785, "compressed_tokens": 526, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 629, "message_tokens": 526, "message_utf8_bytes": 2633, "cache_tensor_bytes": null, "serialized_payload_bytes": 2633, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 759.6773330587894, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.3430420299992, "ttft_ms": 13.725915923714638, "decode_ms": 110.68912490736693}, "total_wall_ms": 201.03583298623562, "ttft_ms": 13.725915923714638, "input_usage": {"receiver_prompt_tokens": 629}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9839738880, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6874922536, "mlx_cache_bytes": 835259616, "process_rss_bytes": 9839738880}, "peak_prefill_memory": null, "peak_decode_memory": 6874922536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 939-D, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9b3e78275d12332cd4f2a7b43eb416eb415b9511b418eb26fa5f5164556f6590", "output_hash": "e6bfa929e380d728a57c6e763534886541434a6508a7c19dea6ddad4c6fa9399"} | ||||
| 13338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "40f06139218fb7c7de574056", "attempt_id": "03cfc2865f47", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:30.735728Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047473342605470564, "origin_tokens": 10785, "compressed_tokens": 526, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 629, "message_tokens": 526, "message_utf8_bytes": 2633, "cache_tensor_bytes": null, "serialized_payload_bytes": 2633, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 759.6773330587894, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.07608307059854, "ttft_ms": 13.65470897872001, "decode_ms": 13.55558296199888}, "total_wall_ms": 103.55204192455858, "ttft_ms": 13.65470897872001, "input_usage": {"receiver_prompt_tokens": 629}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6874922536, "mlx_cache_bytes": 835259616, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6874922536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9b3e78275d12332cd4f2a7b43eb416eb415b9511b418eb26fa5f5164556f6590", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "f576fe7ba04f40e58d6efca0", "attempt_id": "a540aaaf1857", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:30.873812Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047473342605470564, "origin_tokens": 10785, "compressed_tokens": 526, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 625, "message_tokens": 526, "message_utf8_bytes": 2633, "cache_tensor_bytes": null, "serialized_payload_bytes": 2633, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 759.6773330587894, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.77050006855279, "ttft_ms": 13.538541970774531, "decode_ms": 27.188792009837925}, "total_wall_ms": 116.73658399377018, "ttft_ms": 13.538541970774531, "input_usage": {"receiver_prompt_tokens": 625}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6872104488, "mlx_cache_bytes": 1019284704, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6872104488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9b3e78275d12332cd4f2a7b43eb416eb415b9511b418eb26fa5f5164556f6590", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 13340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0276aa2411153bef92eb7419", "attempt_id": "d05eee677dc3", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:31.025720Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047473342605470564, "origin_tokens": 10785, "compressed_tokens": 526, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 632, "message_tokens": 526, "message_utf8_bytes": 2633, "cache_tensor_bytes": null, "serialized_payload_bytes": 2633, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 759.6773330587894, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.8218750813976, "ttft_ms": 13.492457917891443, "decode_ms": 13.526541995815933}, "total_wall_ms": 103.09808410238475, "ttft_ms": 13.492457917891443, "input_usage": {"receiver_prompt_tokens": 632}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 1372444348, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9b3e78275d12332cd4f2a7b43eb416eb415b9511b418eb26fa5f5164556f6590", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "57216020d759a36951f08929", "attempt_id": "6b5ce46cd1ff", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:31.299349Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289756649688738, "origin_tokens": 1767, "compressed_tokens": 596, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 695, "message_tokens": 596, "message_utf8_bytes": 2198, "cache_tensor_bytes": null, "serialized_payload_bytes": 2198, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.11083295755088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.28000004217029, "ttft_ms": 13.447624980472028, "decode_ms": 26.82837494648993}, "total_wall_ms": 122.82749998848885, "ttft_ms": 13.447624980472028, "input_usage": {"receiver_prompt_tokens": 695}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9839738880, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913277744, "mlx_cache_bytes": 503399472, "process_rss_bytes": 9839738880}, "peak_prefill_memory": null, "peak_decode_memory": 6913277744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3a7f9503c5a7bb00284aa19305b3cf05988c4a5063ce27b9e8690c4291dd3600", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 13342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1daa7b2b4e1f93a1b1bd5268", "attempt_id": "799d1b682def", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:31.444561Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289756649688738, "origin_tokens": 1767, "compressed_tokens": 596, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 700, "message_tokens": 596, "message_utf8_bytes": 2198, "cache_tensor_bytes": null, "serialized_payload_bytes": 2198, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.11083295755088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12850005272776, "ttft_ms": 13.662458048202097, "decode_ms": 147.82662503421307}, "total_wall_ms": 243.90291702002287, "ttft_ms": 13.662458048202097, "input_usage": {"receiver_prompt_tokens": 700}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916472644, "mlx_cache_bytes": 920882972, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6916472644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Baie-Comeau, Lot 601-M.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3a7f9503c5a7bb00284aa19305b3cf05988c4a5063ce27b9e8690c4291dd3600", "output_hash": "2eeccd6d37c2c63f57b31872b5edd5689c68051ec61234afbaeccf94cf1ee260"} | ||||
| 13343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "02dbce332efc6512dbed6559", "attempt_id": "23d5915f1f83", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:31.710664Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289756649688738, "origin_tokens": 1767, "compressed_tokens": 596, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 700, "message_tokens": 596, "message_utf8_bytes": 2198, "cache_tensor_bytes": null, "serialized_payload_bytes": 2198, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.11083295755088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.04541699867696, "ttft_ms": 13.534290948882699, "decode_ms": 53.61341708339751}, "total_wall_ms": 149.40987504087389, "ttft_ms": 13.534290948882699, "input_usage": {"receiver_prompt_tokens": 700}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916472644, "mlx_cache_bytes": 920882972, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6916472644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13.4343", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3a7f9503c5a7bb00284aa19305b3cf05988c4a5063ce27b9e8690c4291dd3600", "output_hash": "599bc22e373b1cf7b4679208eb9e515ad0e8dcb88dde0c7f579637ec7d3f3014"} | ||||
| 13344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7546cd00dc46b9e779bb580d", "attempt_id": "df474a13fffe", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:31.882158Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289756649688738, "origin_tokens": 1767, "compressed_tokens": 596, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 696, "message_tokens": 596, "message_utf8_bytes": 2198, "cache_tensor_bytes": null, "serialized_payload_bytes": 2198, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.11083295755088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.48133307602257, "ttft_ms": 13.62195797264576, "decode_ms": 107.36120794899762}, "total_wall_ms": 202.6998749934137, "ttft_ms": 13.62195797264576, "input_usage": {"receiver_prompt_tokens": 696}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913654596, "mlx_cache_bytes": 1125945116, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6913654596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Dubrovnik", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3a7f9503c5a7bb00284aa19305b3cf05988c4a5063ce27b9e8690c4291dd3600", "output_hash": "adc9a20b9adc1d63e08a6e4c1f5160bd8343c4e09ea9e1ab7296ec885a822f95"} | ||||
| 13345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1443d2d802348d6446fe6234", "attempt_id": "86d4b965df26", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:32.107140Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289756649688738, "origin_tokens": 1767, "compressed_tokens": 596, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 701, "message_tokens": 596, "message_utf8_bytes": 2198, "cache_tensor_bytes": null, "serialized_payload_bytes": 2198, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.11083295755088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.14820800255984, "ttft_ms": 13.639417011290789, "decode_ms": 13.375916983932257}, "total_wall_ms": 109.40720909275115, "ttft_ms": 13.639417011290789, "input_usage": {"receiver_prompt_tokens": 701}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916652872, "mlx_cache_bytes": 1263573516, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6916652872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3a7f9503c5a7bb00284aa19305b3cf05988c4a5063ce27b9e8690c4291dd3600", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ee77cb04766b5cb0fdf215f1", "attempt_id": "ee6ea81e6f42", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:32.657794Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09121681810083734, "origin_tokens": 5613, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 711, "message_tokens": 613, "message_utf8_bytes": 2937, "cache_tensor_bytes": null, "serialized_payload_bytes": 2937, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.669666999951, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.84179197996855, "ttft_ms": 13.72908300254494, "decode_ms": 13.961625052616}, "total_wall_ms": 110.92562496196479, "ttft_ms": 13.72908300254494, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839755264, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 512935024, "process_rss_bytes": 9839755264}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "51e05e3cfb30216ccd292f40ec32a8a5fb8950328c8797596f807ef63fbdf4b0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2413a33ec9a6c4f1c4f62422", "attempt_id": "6c7b0e582ac1", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:32.797201Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09121681810083734, "origin_tokens": 5613, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 717, "message_tokens": 613, "message_utf8_bytes": 2937, "cache_tensor_bytes": null, "serialized_payload_bytes": 2937, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.669666999951, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.0821249615401, "ttft_ms": 13.54737498331815, "decode_ms": 122.06437508575618}, "total_wall_ms": 218.0518750101328, "ttft_ms": 13.54737498331815, "input_usage": {"receiver_prompt_tokens": 717}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9839771648, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925926280, "mlx_cache_bytes": 940150688, "process_rss_bytes": 9839771648}, "peak_prefill_memory": null, "peak_decode_memory": 6925926280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Témiscaming, Lot 229-K", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "51e05e3cfb30216ccd292f40ec32a8a5fb8950328c8797596f807ef63fbdf4b0", "output_hash": "156b1d3ced69e67a5176d18a4331fe85d75f1ca47de6ed6a74d646c11b7a32b4"} | ||||
| 13348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "69bcddd21dfce1637b874184", "attempt_id": "65a387c22e44", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:33.042062Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09121681810083734, "origin_tokens": 5613, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 716, "message_tokens": 613, "message_utf8_bytes": 2937, "cache_tensor_bytes": null, "serialized_payload_bytes": 2937, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.669666999951, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.65412496216595, "ttft_ms": 14.080459019169211, "decode_ms": 13.313458068296313}, "total_wall_ms": 109.38216699287295, "ttft_ms": 14.080459019169211, "input_usage": {"receiver_prompt_tokens": 716}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839771648, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925926280, "mlx_cache_bytes": 940150688, "process_rss_bytes": 9839771648}, "peak_prefill_memory": null, "peak_decode_memory": 6925926280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "51e05e3cfb30216ccd292f40ec32a8a5fb8950328c8797596f807ef63fbdf4b0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "de47d6abb2214d2a8c2d707a", "attempt_id": "33a60bf09d80", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:33.178553Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09121681810083734, "origin_tokens": 5613, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 711, "message_tokens": 613, "message_utf8_bytes": 2937, "cache_tensor_bytes": null, "serialized_payload_bytes": 2937, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.669666999951, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.15274994634092, "ttft_ms": 13.453958090394735, "decode_ms": 13.277124962769449}, "total_wall_ms": 109.22012501396239, "ttft_ms": 13.453958090394735, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839771648, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 940150688, "process_rss_bytes": 9839771648}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "51e05e3cfb30216ccd292f40ec32a8a5fb8950328c8797596f807ef63fbdf4b0", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 13350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "3bd1e282205420ee37258e9a", "attempt_id": "aee57800f0ba", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:33.316590Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09121681810083734, "origin_tokens": 5613, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 721, "message_tokens": 613, "message_utf8_bytes": 2937, "cache_tensor_bytes": null, "serialized_payload_bytes": 2937, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.669666999951, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.03683404624462, "ttft_ms": 13.39770806953311, "decode_ms": 13.556249905377626}, "total_wall_ms": 109.29654096253216, "ttft_ms": 13.39770806953311, "input_usage": {"receiver_prompt_tokens": 721}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839771648, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927744920, "mlx_cache_bytes": 1342708448, "process_rss_bytes": 9839771648}, "peak_prefill_memory": null, "peak_decode_memory": 6927744920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "51e05e3cfb30216ccd292f40ec32a8a5fb8950328c8797596f807ef63fbdf4b0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "118429ec5446096b42251904", "attempt_id": "d32a1ba74dac", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:34.214063Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04729355255865509, "origin_tokens": 10826, "compressed_tokens": 521, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 620, "message_tokens": 521, "message_utf8_bytes": 2593, "cache_tensor_bytes": null, "serialized_payload_bytes": 2593, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 756.664082990028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.96812508907169, "ttft_ms": 13.8090830296278, "decode_ms": 13.304666033945978}, "total_wall_ms": 103.30629104282707, "ttft_ms": 13.8090830296278, "input_usage": {"receiver_prompt_tokens": 620}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839886336, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6870105604, "mlx_cache_bytes": 458998532, "process_rss_bytes": 9839886336}, "peak_prefill_memory": null, "peak_decode_memory": 6870105604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8448b83493e8ea18c8cdcc5c9e7612e320cbc803adc62e7160de7908455ca2c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "39f55823032c69f22100111e", "attempt_id": "547a5f4220be", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:34.352328Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04729355255865509, "origin_tokens": 10826, "compressed_tokens": 521, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 627, "message_tokens": 521, "message_utf8_bytes": 2593, "cache_tensor_bytes": null, "serialized_payload_bytes": 2593, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 756.664082990028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.12029202189296, "ttft_ms": 13.407874968834221, "decode_ms": 13.694041059352458}, "total_wall_ms": 103.53154200129211, "ttft_ms": 13.407874968834221, "input_usage": {"receiver_prompt_tokens": 627}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839902720, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660960, "mlx_cache_bytes": 832474316, "process_rss_bytes": 9839902720}, "peak_prefill_memory": null, "peak_decode_memory": 6873660960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8448b83493e8ea18c8cdcc5c9e7612e320cbc803adc62e7160de7908455ca2c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "b1674abefe6525a2114e1ad1", "attempt_id": "db6242747f4f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:34.491513Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04729355255865509, "origin_tokens": 10826, "compressed_tokens": 521, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 626, "message_tokens": 521, "message_utf8_bytes": 2593, "cache_tensor_bytes": null, "serialized_payload_bytes": 2593, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 756.664082990028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.97100008185953, "ttft_ms": 13.47791706211865, "decode_ms": 13.488749973475933}, "total_wall_ms": 103.13612502068281, "ttft_ms": 13.47791706211865, "input_usage": {"receiver_prompt_tokens": 626}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839902720, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660960, "mlx_cache_bytes": 832474316, "process_rss_bytes": 9839902720}, "peak_prefill_memory": null, "peak_decode_memory": 6873660960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8448b83493e8ea18c8cdcc5c9e7612e320cbc803adc62e7160de7908455ca2c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "85b8c2221eef2f2812b35c11", "attempt_id": "70a318654ef6", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:34.628895Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04729355255865509, "origin_tokens": 10826, "compressed_tokens": 521, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 622, "message_tokens": 521, "message_utf8_bytes": 2593, "cache_tensor_bytes": null, "serialized_payload_bytes": 2593, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 756.664082990028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.64166707359254, "ttft_ms": 13.486583949998021, "decode_ms": 13.744125026278198}, "total_wall_ms": 103.06679201312363, "ttft_ms": 13.486583949998021, "input_usage": {"receiver_prompt_tokens": 622}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839902720, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6870662688, "mlx_cache_bytes": 1015712972, "process_rss_bytes": 9839902720}, "peak_prefill_memory": null, "peak_decode_memory": 6870662688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8448b83493e8ea18c8cdcc5c9e7612e320cbc803adc62e7160de7908455ca2c2", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 13355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "23367c740aec333194861d5e", "attempt_id": "ca58f5ceb3c6", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:34.766327Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04729355255865509, "origin_tokens": 10826, "compressed_tokens": 521, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 628, "message_tokens": 521, "message_utf8_bytes": 2593, "cache_tensor_bytes": null, "serialized_payload_bytes": 2593, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 756.664082990028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.45791694428772, "ttft_ms": 13.702999916858971, "decode_ms": 13.603499974124134}, "total_wall_ms": 104.01499993167818, "ttft_ms": 13.702999916858971, "input_usage": {"receiver_prompt_tokens": 628}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839902720, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6874742308, "mlx_cache_bytes": 1366988440, "process_rss_bytes": 9839902720}, "peak_prefill_memory": null, "peak_decode_memory": 6874742308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8448b83493e8ea18c8cdcc5c9e7612e320cbc803adc62e7160de7908455ca2c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "3148b31e2f21e82980a680e5", "attempt_id": "d1d1582c2ea2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:35.040777Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29408385985066055, "origin_tokens": 1741, "compressed_tokens": 610, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 709, "message_tokens": 610, "message_utf8_bytes": 2227, "cache_tensor_bytes": null, "serialized_payload_bytes": 2227, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.59024999570101, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.21574996039271, "ttft_ms": 13.811833108775318, "decode_ms": 111.53400002513081}, "total_wall_ms": 207.9266660148278, "ttft_ms": 13.811833108775318, "input_usage": {"receiver_prompt_tokens": 709}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9839919104, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921289576, "mlx_cache_bytes": 511640680, "process_rss_bytes": 9839919104}, "peak_prefill_memory": null, "peak_decode_memory": 6921289576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GK-89M-5278", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5ff9eec84b479180cc771b15d683184131094a132cb3edc87caeef285e56096e", "output_hash": "4e341227263a52b9d9acb67622f40b4070f4066768b00cd60b5a08c6be006b0a"} | ||||
| 13357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0204d2def3f80c04b9f20a62", "attempt_id": "fe5bcb050637", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:35.271102Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29408385985066055, "origin_tokens": 1741, "compressed_tokens": 610, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 713, "message_tokens": 610, "message_utf8_bytes": 2227, "cache_tensor_bytes": null, "serialized_payload_bytes": 2227, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.59024999570101, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.45070797763765, "ttft_ms": 13.928917003795505, "decode_ms": 13.688832987099886}, "total_wall_ms": 110.44887499883771, "ttft_ms": 13.928917003795505, "input_usage": {"receiver_prompt_tokens": 713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6923108216, "mlx_cache_bytes": 909725576, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6923108216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5ff9eec84b479180cc771b15d683184131094a132cb3edc87caeef285e56096e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9ba26f538448fc25e6b077ac", "attempt_id": "54df6d79e0c5", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:35.404074Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29408385985066055, "origin_tokens": 1741, "compressed_tokens": 610, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 713, "message_tokens": 610, "message_utf8_bytes": 2227, "cache_tensor_bytes": null, "serialized_payload_bytes": 2227, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.59024999570101, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.07254188507795, "ttft_ms": 14.472457929514349, "decode_ms": 69.4129589246586}, "total_wall_ms": 166.226250003092, "ttft_ms": 14.472457929514349, "input_usage": {"receiver_prompt_tokens": 713}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6923108216, "mlx_cache_bytes": 909725576, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6923108216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "89. 3122", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5ff9eec84b479180cc771b15d683184131094a132cb3edc87caeef285e56096e", "output_hash": "9b72a5068196d31468c2f7467ca0b8b8801150b4c9a72ca9432036e36791bfe2"} | ||||
| 13359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "565191a3b8d09fdf24e3f48e", "attempt_id": "704a858b8a4e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:35.591665Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29408385985066055, "origin_tokens": 1741, "compressed_tokens": 610, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 709, "message_tokens": 610, "message_utf8_bytes": 2227, "cache_tensor_bytes": null, "serialized_payload_bytes": 2227, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.59024999570101, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.01699990220368, "ttft_ms": 13.653417001478374, "decode_ms": 82.77883299160749}, "total_wall_ms": 178.81191603373736, "ttft_ms": 13.653417001478374, "input_usage": {"receiver_prompt_tokens": 709}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921289576, "mlx_cache_bytes": 909725576, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6921289576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Dubrovnik", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5ff9eec84b479180cc771b15d683184131094a132cb3edc87caeef285e56096e", "output_hash": "f42f05ebfc96f7258cbfbbb37cd65e114d3d15f869e68e6c95b71fc288c30a32"} | ||||
| 13360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ca34e6c6deeac90a15e97aa4", "attempt_id": "936bd9e5ea62", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:35.792878Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29408385985066055, "origin_tokens": 1741, "compressed_tokens": 610, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 718, "message_tokens": 610, "message_utf8_bytes": 2227, "cache_tensor_bytes": null, "serialized_payload_bytes": 2227, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.59024999570101, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.49204105231911, "ttft_ms": 13.704000040888786, "decode_ms": 27.36558299511671}, "total_wall_ms": 124.84249996487051, "ttft_ms": 13.704000040888786, "input_usage": {"receiver_prompt_tokens": 718}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6926303116, "mlx_cache_bytes": 1337334460, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6926303116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "725 EUR", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5ff9eec84b479180cc771b15d683184131094a132cb3edc87caeef285e56096e", "output_hash": "d85375dd97abd95564a909c90ac971b79b2e3762a41def5871d5ca6734672cde"} | ||||
| 13361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "bf7753afe9d2b4a86c0fd377", "attempt_id": "d132d0711ad7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:36.355334Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09124933166993406, "origin_tokens": 5611, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 692, "message_tokens": 594, "message_utf8_bytes": 2928, "cache_tensor_bytes": null, "serialized_payload_bytes": 2928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 412.7760409610346, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.34087501093745, "ttft_ms": 13.54212500154972, "decode_ms": 81.27537497784942}, "total_wall_ms": 177.56204202305526, "ttft_ms": 13.54212500154972, "input_usage": {"receiver_prompt_tokens": 692}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9839919104, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6911835940, "mlx_cache_bytes": 501908516, "process_rss_bytes": 9839919104}, "peak_prefill_memory": null, "peak_decode_memory": 6911835940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2f4ee550cc74023c50f425edfedc7505ba10b7380173105284a8c21d9f1c7e38", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | ||||
| 13362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "59b4b3a5fada3de4dcff75c6", "attempt_id": "3dea41b30390", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:36.560880Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09124933166993406, "origin_tokens": 5611, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 697, "message_tokens": 594, "message_utf8_bytes": 2928, "cache_tensor_bytes": null, "serialized_payload_bytes": 2928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 412.7760409610346, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.4879999961704, "ttft_ms": 13.52029200643301, "decode_ms": 80.69570793304592}, "total_wall_ms": 177.01116704847664, "ttft_ms": 13.52029200643301, "input_usage": {"receiver_prompt_tokens": 697}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 891047684, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithwenmel-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2f4ee550cc74023c50f425edfedc7505ba10b7380173105284a8c21d9f1c7e38", "output_hash": "49cf3f58cd63c02c44a8005ad5268d67c15d58ba53b9dd350b3a4150d539e1fd"} | ||||
| 13363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "6178c5b32e5c1c795720503f", "attempt_id": "9c48efc6fc12", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:36.765604Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09124933166993406, "origin_tokens": 5611, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 696, "message_tokens": 594, "message_utf8_bytes": 2928, "cache_tensor_bytes": null, "serialized_payload_bytes": 2928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 412.7760409610346, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.87954099755734, "ttft_ms": 13.772791950032115, "decode_ms": 13.41762498486787}, "total_wall_ms": 109.40745798870921, "ttft_ms": 13.772791950032115, "input_usage": {"receiver_prompt_tokens": 696}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 891047684, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2f4ee550cc74023c50f425edfedc7505ba10b7380173105284a8c21d9f1c7e38", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "acf337f1bdd849663bf8fae4", "attempt_id": "a4ea8b3156e7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:36.902434Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09124933166993406, "origin_tokens": 5611, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 694, "message_tokens": 594, "message_utf8_bytes": 2928, "cache_tensor_bytes": null, "serialized_payload_bytes": 2928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 412.7760409610346, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.02004195097834, "ttft_ms": 13.674958958290517, "decode_ms": 13.439708040095866}, "total_wall_ms": 109.42087497096509, "ttft_ms": 13.674958958290517, "input_usage": {"receiver_prompt_tokens": 694}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6912589624, "mlx_cache_bytes": 1027297028, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6912589624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2f4ee550cc74023c50f425edfedc7505ba10b7380173105284a8c21d9f1c7e38", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e7a22aa9cb81134f4adc40ad", "attempt_id": "5973e5869f92", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:37.038581Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09124933166993406, "origin_tokens": 5611, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 701, "message_tokens": 594, "message_utf8_bytes": 2928, "cache_tensor_bytes": null, "serialized_payload_bytes": 2928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 412.7760409610346, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.8092079134658, "ttft_ms": 13.614792027510703, "decode_ms": 13.366665923967957}, "total_wall_ms": 110.06366601213813, "ttft_ms": 13.614792027510703, "input_usage": {"receiver_prompt_tokens": 701}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9839935488, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916652872, "mlx_cache_bytes": 1444977140, "process_rss_bytes": 9839935488}, "peak_prefill_memory": null, "peak_decode_memory": 6916652872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2f4ee550cc74023c50f425edfedc7505ba10b7380173105284a8c21d9f1c7e38", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "350bc555103428082d3925a8", "attempt_id": "faa784f6279a", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:37.942924Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047451343836886005, "origin_tokens": 10790, "compressed_tokens": 524, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 623, "message_tokens": 524, "message_utf8_bytes": 2629, "cache_tensor_bytes": null, "serialized_payload_bytes": 2629, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 763.3149999892339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.93025006260723, "ttft_ms": 13.506458955816925, "decode_ms": 13.53600004222244}, "total_wall_ms": 103.25541696511209, "ttft_ms": 13.506458955816925, "input_usage": {"receiver_prompt_tokens": 623}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840017408, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6871547408, "mlx_cache_bytes": 460489488, "process_rss_bytes": 9840017408}, "peak_prefill_memory": null, "peak_decode_memory": 6871547408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d0e66bf1e934fdda4ef50f32f3b6818e97e0088725056daad0e120c3a39a244c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "74535baea19cc629bdbbd597", "attempt_id": "7c306b9b0d1f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.081486Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047451343836886005, "origin_tokens": 10790, "compressed_tokens": 524, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 630, "message_tokens": 524, "message_utf8_bytes": 2629, "cache_tensor_bytes": null, "serialized_payload_bytes": 2629, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 763.3149999892339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.61358402017504, "ttft_ms": 13.45079205930233, "decode_ms": 13.561500003561378}, "total_wall_ms": 103.83587493561208, "ttft_ms": 13.45079205930233, "input_usage": {"receiver_prompt_tokens": 630}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6875299372, "mlx_cache_bytes": 835652836, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6875299372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d0e66bf1e934fdda4ef50f32f3b6818e97e0088725056daad0e120c3a39a244c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9dfd27fcbd6406e46fa26495", "attempt_id": "0fd9d738b657", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.220060Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047451343836886005, "origin_tokens": 10790, "compressed_tokens": 524, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 628, "message_tokens": 524, "message_utf8_bytes": 2629, "cache_tensor_bytes": null, "serialized_payload_bytes": 2629, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 763.3149999892339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.93670901749283, "ttft_ms": 13.974540983326733, "decode_ms": 13.573957956396043}, "total_wall_ms": 103.84933289606124, "ttft_ms": 13.974540983326733, "input_usage": {"receiver_prompt_tokens": 628}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6874938924, "mlx_cache_bytes": 958926052, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6874938924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d0e66bf1e934fdda4ef50f32f3b6818e97e0088725056daad0e120c3a39a244c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e28eff027b0f6afda3f4a72c", "attempt_id": "93df50c4abdf", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.358185Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047451343836886005, "origin_tokens": 10790, "compressed_tokens": 524, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 624, "message_tokens": 524, "message_utf8_bytes": 2629, "cache_tensor_bytes": null, "serialized_payload_bytes": 2629, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 763.3149999892339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.70149989239872, "ttft_ms": 13.344959006644785, "decode_ms": 13.604625011794269}, "total_wall_ms": 102.87079203408211, "ttft_ms": 13.344959006644785, "input_usage": {"receiver_prompt_tokens": 624}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6871924268, "mlx_cache_bytes": 1142754532, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6871924268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d0e66bf1e934fdda4ef50f32f3b6818e97e0088725056daad0e120c3a39a244c", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 13370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1c918eaec76830ba78cf2371", "attempt_id": "7377a7076671", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.495544Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047451343836886005, "origin_tokens": 10790, "compressed_tokens": 524, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 633, "message_tokens": 524, "message_utf8_bytes": 2629, "cache_tensor_bytes": null, "serialized_payload_bytes": 2629, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 763.3149999892339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.71449992246926, "ttft_ms": 13.53616698179394, "decode_ms": 13.394333887845278}, "total_wall_ms": 104.24224997404963, "ttft_ms": 13.53616698179394, "input_usage": {"receiver_prompt_tokens": 633}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876741176, "mlx_cache_bytes": 1496110788, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6876741176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d0e66bf1e934fdda4ef50f32f3b6818e97e0088725056daad0e120c3a39a244c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "eb64745c5f6d6f799b99d649", "attempt_id": "145c5d2a602b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.770719Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1783, "compressed_tokens": 612, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 708, "message_tokens": 610, "message_utf8_bytes": 2127, "cache_tensor_bytes": null, "serialized_payload_bytes": 2127, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.36312491446733, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.30666706711054, "ttft_ms": 13.794000027701259, "decode_ms": 93.79004093352705}, "total_wall_ms": 190.17916708253324, "ttft_ms": 13.794000027701259, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9840017408, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921109348, "mlx_cache_bytes": 511444068, "process_rss_bytes": 9840017408}, "peak_prefill_memory": null, "peak_decode_memory": 6921109348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SL-13P-4841", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d79910d4ccd929e27a520bda24364730d36c6e4d3cf9750954807cf1b9ef70e5", "output_hash": "86d74277112be603caee39e722d1da2de1ddedf93b74b26bb742e3f437da2193"} | ||||
| 13372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0955af517b4308d51156895a", "attempt_id": "7773592558b1", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:38.983448Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1783, "compressed_tokens": 612, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 714, "message_tokens": 610, "message_utf8_bytes": 2127, "cache_tensor_bytes": null, "serialized_payload_bytes": 2127, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.36312491446733, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.05954108759761, "ttft_ms": 13.46366701181978, "decode_ms": 121.3793329661712}, "total_wall_ms": 217.1675420831889, "ttft_ms": 13.46366701181978, "input_usage": {"receiver_prompt_tokens": 714}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924484476, "mlx_cache_bytes": 937168776, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6924484476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 951-P, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d79910d4ccd929e27a520bda24364730d36c6e4d3cf9750954807cf1b9ef70e5", "output_hash": "8b7e0edb9b534e12b8d9c8efa4240c2479f9f53dd4387d847d38dab5f30fe569"} | ||||
| 13373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "78840ccee53685c10f1f8f6c", "attempt_id": "e69cb8e40dc5", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:39.222790Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1783, "compressed_tokens": 612, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 713, "message_tokens": 610, "message_utf8_bytes": 2127, "cache_tensor_bytes": null, "serialized_payload_bytes": 2127, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.36312491446733, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.43666707817465, "ttft_ms": 13.499000109732151, "decode_ms": 67.28566705714911}, "total_wall_ms": 162.4609159771353, "ttft_ms": 13.499000109732151, "input_usage": {"receiver_prompt_tokens": 713}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924189564, "mlx_cache_bytes": 937168776, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6924189564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "77. 6813", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d79910d4ccd929e27a520bda24364730d36c6e4d3cf9750954807cf1b9ef70e5", "output_hash": "c4e0ad5c4e7cb95c9eaa9154c193a2aa34c479871a18231c1780014122c1b113"} | ||||
| 13374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1c6664eff8569b8bfb993601", "attempt_id": "2f669423d858", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:39.407233Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1783, "compressed_tokens": 612, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 710, "message_tokens": 610, "message_utf8_bytes": 2127, "cache_tensor_bytes": null, "serialized_payload_bytes": 2127, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.36312491446733, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.95870888791978, "ttft_ms": 13.677624985575676, "decode_ms": 26.942666969262064}, "total_wall_ms": 122.73366702720523, "ttft_ms": 13.677624985575676, "input_usage": {"receiver_prompt_tokens": 710}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921666428, "mlx_cache_bytes": 1146359688, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6921666428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d79910d4ccd929e27a520bda24364730d36c6e4d3cf9750954807cf1b9ef70e5", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 13375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0e36f93333055935ed3a0b15", "attempt_id": "84724efd2a45", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:39.551928Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1783, "compressed_tokens": 612, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 718, "message_tokens": 610, "message_utf8_bytes": 2127, "cache_tensor_bytes": null, "serialized_payload_bytes": 2127, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.36312491446733, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.2665419653058, "ttft_ms": 13.670040993019938, "decode_ms": 68.10116593260318}, "total_wall_ms": 164.26904092077166, "ttft_ms": 13.670040993019938, "input_usage": {"receiver_prompt_tokens": 718}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6926303116, "mlx_cache_bytes": 1547426492, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6926303116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,296,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d79910d4ccd929e27a520bda24364730d36c6e4d3cf9750954807cf1b9ef70e5", "output_hash": "8b531ccf7fd3b97bf2ef32627da2617b8353e5c2dd09a274017a5a5a868bdcdb"} | ||||
| 13376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "eec4b7a254cbd2d30a6783d0", "attempt_id": "8edb991c97ca", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:40.153398Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09131442839308009, "origin_tokens": 5607, "compressed_tokens": 608, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5607, "source_tokens_receiver": 5607, "query_tokens": 707, "message_tokens": 608, "message_utf8_bytes": 2904, "cache_tensor_bytes": null, "serialized_payload_bytes": 2904, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.6947080474347, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.3903339440003, "ttft_ms": 13.688875013031065, "decode_ms": 13.582292012870312}, "total_wall_ms": 110.0582079961896, "ttft_ms": 13.688875013031065, "input_usage": {"receiver_prompt_tokens": 707}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840033792, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6920028000, "mlx_cache_bytes": 510346336, "process_rss_bytes": 9840033792}, "peak_prefill_memory": null, "peak_decode_memory": 6920028000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "fcedf0dfa4477545dc403e957b9900c03632fd942a1c89dd753c42bd466437ca", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0c18c1d4feaba1ffd4d078de", "attempt_id": "92d6862a9ad7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:40.291822Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09131442839308009, "origin_tokens": 5607, "compressed_tokens": 608, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5607, "source_tokens_receiver": 5607, "query_tokens": 711, "message_tokens": 608, "message_utf8_bytes": 2904, "cache_tensor_bytes": null, "serialized_payload_bytes": 2904, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.6947080474347, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.43854199443012, "ttft_ms": 13.52491695433855, "decode_ms": 121.32429203484207}, "total_wall_ms": 217.58012496866286, "ttft_ms": 13.52491695433855, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9840050176, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 907841400, "process_rss_bytes": 9840050176}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 69-B, La Tuque.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.888888888888889}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "fcedf0dfa4477545dc403e957b9900c03632fd942a1c89dd753c42bd466437ca", "output_hash": "ae102defa198878a85f267bb05366209b7afd2e13fade185988545130aed376c"} | ||||
| 13378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "6776ca83fee28a29a164da74", "attempt_id": "b3bf81b0ecc2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:40.536822Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09131442839308009, "origin_tokens": 5607, "compressed_tokens": 608, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5607, "source_tokens_receiver": 5607, "query_tokens": 711, "message_tokens": 608, "message_utf8_bytes": 2904, "cache_tensor_bytes": null, "serialized_payload_bytes": 2904, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.6947080474347, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.26370795071125, "ttft_ms": 13.698415947146714, "decode_ms": 13.371917069889605}, "total_wall_ms": 109.61904202122241, "ttft_ms": 13.698415947146714, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840050176, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 907841400, "process_rss_bytes": 9840050176}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "fcedf0dfa4477545dc403e957b9900c03632fd942a1c89dd753c42bd466437ca", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2b67176dae86f76ce0847c5c", "attempt_id": "9382e579ed87", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:40.673608Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09131442839308009, "origin_tokens": 5607, "compressed_tokens": 608, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5607, "source_tokens_receiver": 5607, "query_tokens": 707, "message_tokens": 608, "message_utf8_bytes": 2904, "cache_tensor_bytes": null, "serialized_payload_bytes": 2904, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.6947080474347, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.69295901805162, "ttft_ms": 13.776125037111342, "decode_ms": 27.38616697024554}, "total_wall_ms": 123.14591591712087, "ttft_ms": 13.776125037111342, "input_usage": {"receiver_prompt_tokens": 707}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840050176, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6920028000, "mlx_cache_bytes": 907841400, "process_rss_bytes": 9840050176}, "peak_prefill_memory": null, "peak_decode_memory": 6920028000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "fcedf0dfa4477545dc403e957b9900c03632fd942a1c89dd753c42bd466437ca", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 13380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "a7a907c5abbd9b9f9954beb1", "attempt_id": "d0e2b9e0ac6e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:40.825307Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09131442839308009, "origin_tokens": 5607, "compressed_tokens": 608, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5607, "source_tokens_receiver": 5607, "query_tokens": 713, "message_tokens": 608, "message_utf8_bytes": 2904, "cache_tensor_bytes": null, "serialized_payload_bytes": 2904, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.6947080474347, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.62379201874137, "ttft_ms": 13.540875050239265, "decode_ms": 13.613624963909388}, "total_wall_ms": 109.08341594040394, "ttft_ms": 13.540875050239265, "input_usage": {"receiver_prompt_tokens": 713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840050176, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6923108216, "mlx_cache_bytes": 1117821592, "process_rss_bytes": 9840050176}, "peak_prefill_memory": null, "peak_decode_memory": 6923108216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "fcedf0dfa4477545dc403e957b9900c03632fd942a1c89dd753c42bd466437ca", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "bdc304a5ce47b37598ed4b90", "attempt_id": "97d359b69125", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:41.731025Z", "task_family": "synthetic", "document_id": "syn_03020_16000", "document_hash": "4b594f32d4e18cae34a0b4b72741bb2f8306989a08d8989ff4a6fe026f126b6d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03020_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0475218117690737, "origin_tokens": 10774, "compressed_tokens": 535, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10774, "source_tokens_receiver": 10774, "query_tokens": 632, "message_tokens": 535, "message_utf8_bytes": 2602, "cache_tensor_bytes": null, "serialized_payload_bytes": 2602, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.4559169895947, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.07566704973578, "ttft_ms": 13.83874996099621, "decode_ms": 13.782207970507443}, "total_wall_ms": 105.04250007215887, "ttft_ms": 13.83874996099621, "input_usage": {"receiver_prompt_tokens": 632}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840082944, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 465650484, "process_rss_bytes": 9840082944}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03020_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f278e598c7c8cba1ccac8187739c3b358b734c4a95dfdb9fb8240164af4d8835", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "3dfaf34171b6bbc6fe8c5f4a", "attempt_id": "46f933511a89", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:41.871952Z", "task_family": "synthetic", "document_id": "syn_03020_16000", "document_hash": "4b594f32d4e18cae34a0b4b72741bb2f8306989a08d8989ff4a6fe026f126b6d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03020_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0475218117690737, "origin_tokens": 10774, "compressed_tokens": 535, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10774, "source_tokens_receiver": 10774, "query_tokens": 638, "message_tokens": 535, "message_utf8_bytes": 2602, "cache_tensor_bytes": null, "serialized_payload_bytes": 2602, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.4559169895947, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.07850001659244, "ttft_ms": 13.680667034350336, "decode_ms": 13.399334042333066}, "total_wall_ms": 104.42070907447487, "ttft_ms": 13.680667034350336, "input_usage": {"receiver_prompt_tokens": 638}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879936076, "mlx_cache_bytes": 845581608, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6879936076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03020_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f278e598c7c8cba1ccac8187739c3b358b734c4a95dfdb9fb8240164af4d8835", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "b1f5bd797c82c66557b10698", "attempt_id": "85e64fe881ea", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.011122Z", "task_family": "synthetic", "document_id": "syn_03020_16000", "document_hash": "4b594f32d4e18cae34a0b4b72741bb2f8306989a08d8989ff4a6fe026f126b6d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03020_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0475218117690737, "origin_tokens": 10774, "compressed_tokens": 535, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10774, "source_tokens_receiver": 10774, "query_tokens": 639, "message_tokens": 535, "message_utf8_bytes": 2602, "cache_tensor_bytes": null, "serialized_payload_bytes": 2602, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.4559169895947, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.12862507812679, "ttft_ms": 13.579874997958541, "decode_ms": 13.42275005299598}, "total_wall_ms": 104.38249993603677, "ttft_ms": 13.579874997958541, "input_usage": {"receiver_prompt_tokens": 639}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6880820816, "mlx_cache_bytes": 1140102944, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6880820816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03020_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f278e598c7c8cba1ccac8187739c3b358b734c4a95dfdb9fb8240164af4d8835", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e3545ff828f6c43eee55b12f", "attempt_id": "c6afac65dd0c", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.150237Z", "task_family": "synthetic", "document_id": "syn_03020_16000", "document_hash": "4b594f32d4e18cae34a0b4b72741bb2f8306989a08d8989ff4a6fe026f126b6d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03020_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0475218117690737, "origin_tokens": 10774, "compressed_tokens": 535, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10774, "source_tokens_receiver": 10774, "query_tokens": 635, "message_tokens": 535, "message_utf8_bytes": 2602, "cache_tensor_bytes": null, "serialized_payload_bytes": 2602, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.4559169895947, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.50033391453326, "ttft_ms": 13.583875028416514, "decode_ms": 26.827708003111184}, "total_wall_ms": 117.1373330289498, "ttft_ms": 13.583875028416514, "input_usage": {"receiver_prompt_tokens": 635}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6910164556, "mlx_cache_bytes": 1366071072, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6910164556, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03020_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f278e598c7c8cba1ccac8187739c3b358b734c4a95dfdb9fb8240164af4d8835", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 13385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "347ee16e10550ea5a10084be", "attempt_id": "86b2638ff588", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.301738Z", "task_family": "synthetic", "document_id": "syn_03020_16000", "document_hash": "4b594f32d4e18cae34a0b4b72741bb2f8306989a08d8989ff4a6fe026f126b6d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03020_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0475218117690737, "origin_tokens": 10774, "compressed_tokens": 535, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10774, "source_tokens_receiver": 10774, "query_tokens": 643, "message_tokens": 535, "message_utf8_bytes": 2602, "cache_tensor_bytes": null, "serialized_payload_bytes": 2602, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 765.4559169895947, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.93879094626755, "ttft_ms": 13.547459035180509, "decode_ms": 13.596541015431285}, "total_wall_ms": 107.32608300168067, "ttft_ms": 13.547459035180509, "input_usage": {"receiver_prompt_tokens": 643}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6882934368, "mlx_cache_bytes": 1749082408, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6882934368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03020_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f278e598c7c8cba1ccac8187739c3b358b734c4a95dfdb9fb8240164af4d8835", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fab1b06d5b196b857bcabde2", "attempt_id": "6fed38d99b2f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.579859Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29681159420289854, "origin_tokens": 1725, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1725, "source_tokens_receiver": 1725, "query_tokens": 708, "message_tokens": 611, "message_utf8_bytes": 2218, "cache_tensor_bytes": null, "serialized_payload_bytes": 2218, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.24212499335408, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.44983393140137, "ttft_ms": 13.77808302640915, "decode_ms": 80.717624980025}, "total_wall_ms": 177.26650007534772, "ttft_ms": 13.77808302640915, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921109348, "mlx_cache_bytes": 511444068, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6921109348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "-49S-8868", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "4195cfbc0a9206cfd90ead6cc7bf27b83d2fb3f4410726e38af66ba3aab5c1f7", "output_hash": "b3088a5962a1da8d5dd2c274e8b89ca473ed861e1a5632decf895b279b3cf828"} | ||||
| 13387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "23216966b836b6f50224d27f", "attempt_id": "532ae6c71afc", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.779809Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29681159420289854, "origin_tokens": 1725, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1725, "source_tokens_receiver": 1725, "query_tokens": 714, "message_tokens": 611, "message_utf8_bytes": 2218, "cache_tensor_bytes": null, "serialized_payload_bytes": 2218, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.24212499335408, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.85654198657721, "ttft_ms": 13.590832939371467, "decode_ms": 13.501083012670279}, "total_wall_ms": 109.21716596931219, "ttft_ms": 13.590832939371467, "input_usage": {"receiver_prompt_tokens": 714}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924484476, "mlx_cache_bytes": 937168776, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6924484476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "4195cfbc0a9206cfd90ead6cc7bf27b83d2fb3f4410726e38af66ba3aab5c1f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9c722ce4605d9ebeab9eb0d7", "attempt_id": "3158292a711a", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:42.911050Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29681159420289854, "origin_tokens": 1725, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1725, "source_tokens_receiver": 1725, "query_tokens": 714, "message_tokens": 611, "message_utf8_bytes": 2218, "cache_tensor_bytes": null, "serialized_payload_bytes": 2218, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.24212499335408, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.71325009223074, "ttft_ms": 13.654708047397435, "decode_ms": 53.93966694828123}, "total_wall_ms": 149.54354206565768, "ttft_ms": 13.654708047397435, "input_usage": {"receiver_prompt_tokens": 714}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924484476, "mlx_cache_bytes": 937168776, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6924484476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "70.4868", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "4195cfbc0a9206cfd90ead6cc7bf27b83d2fb3f4410726e38af66ba3aab5c1f7", "output_hash": "3206dbd8e13578fb94e0e033d60c7739a36853f2fc9dc1b4fc6d96c771480b14"} | ||||
| 13389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "effbfb4e433ed1baf6af4ced", "attempt_id": "2df527bc67e8", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:43.082619Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29681159420289854, "origin_tokens": 1725, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1725, "source_tokens_receiver": 1725, "query_tokens": 711, "message_tokens": 611, "message_utf8_bytes": 2218, "cache_tensor_bytes": null, "serialized_payload_bytes": 2218, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.24212499335408, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.49529197160155, "ttft_ms": 13.652167050167918, "decode_ms": 53.80370910279453}, "total_wall_ms": 149.24495795276016, "ttft_ms": 13.652167050167918, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6899957616, "mlx_cache_bytes": 1124781960, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6899957616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "4195cfbc0a9206cfd90ead6cc7bf27b83d2fb3f4410726e38af66ba3aab5c1f7", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 13390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "901b6641282f37e5cdbab32b", "attempt_id": "813289ac8753", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:43.253909Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29681159420289854, "origin_tokens": 1725, "compressed_tokens": 611, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1725, "source_tokens_receiver": 1725, "query_tokens": 718, "message_tokens": 611, "message_utf8_bytes": 2218, "cache_tensor_bytes": null, "serialized_payload_bytes": 2218, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.24212499335408, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.26120897941291, "ttft_ms": 13.597709010355175, "decode_ms": 67.73312494624406}, "total_wall_ms": 163.84679195471108, "ttft_ms": 13.597709010355175, "input_usage": {"receiver_prompt_tokens": 718}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6926303116, "mlx_cache_bytes": 1525848764, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6926303116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,505,050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "4195cfbc0a9206cfd90ead6cc7bf27b83d2fb3f4410726e38af66ba3aab5c1f7", "output_hash": "ce50815ff9cdaab72b318f821f80a5ad96dc257c6df51048d6fd9c743b4157c6"} | ||||
| 13391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d73dcf2106d17b17875c7f69", "attempt_id": "29e62f496d18", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:43.853733Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09102222222222223, "origin_tokens": 5625, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5625, "source_tokens_receiver": 5625, "query_tokens": 725, "message_tokens": 628, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.2218330372125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.5124999973923, "ttft_ms": 13.566624955274165, "decode_ms": 13.57391697820276}, "total_wall_ms": 111.0671660862863, "ttft_ms": 13.566624955274165, "input_usage": {"receiver_prompt_tokens": 725}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840099328, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930562984, "mlx_cache_bytes": 521176232, "process_rss_bytes": 9840099328}, "peak_prefill_memory": null, "peak_decode_memory": 6930562984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3cf767abb031e398a10755b8979a1e61a3c6597c3dd32313883b75d396397f64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "f9d9537981975c1e42bd69bb", "attempt_id": "27e0cb456fc3", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:43.993289Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09102222222222223, "origin_tokens": 5625, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5625, "source_tokens_receiver": 5625, "query_tokens": 732, "message_tokens": 628, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.2218330372125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.60216698888689, "ttft_ms": 13.518957886844873, "decode_ms": 81.08383300714195}, "total_wall_ms": 177.55912500433624, "ttft_ms": 13.518957886844873, "input_usage": {"receiver_prompt_tokens": 732}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935019460, "mlx_cache_bytes": 957730836, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6935019460, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Rouyn-Noranda", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.4}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3cf767abb031e398a10755b8979a1e61a3c6597c3dd32313883b75d396397f64", "output_hash": "af7f83537a0d3375a2abccf86d8e250ff5970a50cb182a500cd005d4cdfa06a3"} | ||||
| 13393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "eda2d175c11ed45d2b94e4d8", "attempt_id": "12334f2b344b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:44.198190Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09102222222222223, "origin_tokens": 5625, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5625, "source_tokens_receiver": 5625, "query_tokens": 733, "message_tokens": 628, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.2218330372125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.5901670139283, "ttft_ms": 13.704749988391995, "decode_ms": 13.565000030212104}, "total_wall_ms": 110.18908303231001, "ttft_ms": 13.704749988391995, "input_usage": {"receiver_prompt_tokens": 733}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935199688, "mlx_cache_bytes": 1101650820, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6935199688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3cf767abb031e398a10755b8979a1e61a3c6597c3dd32313883b75d396397f64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e769fff4227bf9eea45e0c9b", "attempt_id": "7fb0a56ec809", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:44.335930Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09102222222222223, "origin_tokens": 5625, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5625, "source_tokens_receiver": 5625, "query_tokens": 727, "message_tokens": 628, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.2218330372125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.42683398909867, "ttft_ms": 13.72387504670769, "decode_ms": 13.445000047795475}, "total_wall_ms": 109.91854197345674, "ttft_ms": 13.72387504670769, "input_usage": {"receiver_prompt_tokens": 727}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6931824580, "mlx_cache_bytes": 1508088708, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6931824580, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3cf767abb031e398a10755b8979a1e61a3c6597c3dd32313883b75d396397f64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fa00eff2ebbad0463be910ab", "attempt_id": "5704098f0db9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:44.472916Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09102222222222223, "origin_tokens": 5625, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5625, "source_tokens_receiver": 5625, "query_tokens": 738, "message_tokens": 628, "message_utf8_bytes": 2932, "cache_tensor_bytes": null, "serialized_payload_bytes": 2932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.2218330372125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.87045895121992, "ttft_ms": 13.720500050112605, "decode_ms": 13.567875022999942}, "total_wall_ms": 111.536749987863, "ttft_ms": 13.720500050112605, "input_usage": {"receiver_prompt_tokens": 738}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840115712, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6938394588, "mlx_cache_bytes": 1948116744, "process_rss_bytes": 9840115712}, "peak_prefill_memory": null, "peak_decode_memory": 6938394588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3cf767abb031e398a10755b8979a1e61a3c6597c3dd32313883b75d396397f64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "07c032e0befd2132ef85e93f", "attempt_id": "d3dbff34e485", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:45.380855Z", "task_family": "synthetic", "document_id": "syn_03023_16000", "document_hash": "6dcdc8a309dbe960e69546d93eb8d8bf0eda3b871dc830f6e35fde9329c07fc4", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03023_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04825636192271442, "origin_tokens": 10618, "compressed_tokens": 527, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10610, "source_tokens_receiver": 10610, "query_tokens": 626, "message_tokens": 527, "message_utf8_bytes": 2594, "cache_tensor_bytes": null, "serialized_payload_bytes": 2594, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.2882500076666, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.5418750923127, "ttft_ms": 13.63354199565947, "decode_ms": 13.568541966378689}, "total_wall_ms": 104.01291691232473, "ttft_ms": 13.63354199565947, "input_usage": {"receiver_prompt_tokens": 626}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840164864, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873480732, "mlx_cache_bytes": 462471964, "process_rss_bytes": 9840164864}, "peak_prefill_memory": null, "peak_decode_memory": 6873480732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03023_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cc31dfd4d29db2c64647304bbf99a4cd6578b571b4dfab52569d21c71c81fdd0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d5fad0f0a6e6d0961266728b", "attempt_id": "980a9a1680d8", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:45.520010Z", "task_family": "synthetic", "document_id": "syn_03023_16000", "document_hash": "6dcdc8a309dbe960e69546d93eb8d8bf0eda3b871dc830f6e35fde9329c07fc4", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03023_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04825636192271442, "origin_tokens": 10618, "compressed_tokens": 527, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10610, "source_tokens_receiver": 10610, "query_tokens": 631, "message_tokens": 527, "message_utf8_bytes": 2594, "cache_tensor_bytes": null, "serialized_payload_bytes": 2594, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.2882500076666, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.67095791455358, "ttft_ms": 13.434540946036577, "decode_ms": 215.58258403092623}, "total_wall_ms": 305.9170419583097, "ttft_ms": 13.434540946036577, "input_usage": {"receiver_prompt_tokens": 631}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876184112, "mlx_cache_bytes": 815238388, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6876184112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quimunker-11, Lot 121-Z, Ostkovar-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03023_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.25}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cc31dfd4d29db2c64647304bbf99a4cd6578b571b4dfab52569d21c71c81fdd0", "output_hash": "26f171295680c488e81308be2f8f0ccde5c0cb82445171d2b8785b6533db2faf"} | ||||
| 13398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8868a9d73cd11f98f84393d3", "attempt_id": "a9686c9b36d6", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:45.860320Z", "task_family": "synthetic", "document_id": "syn_03023_16000", "document_hash": "6dcdc8a309dbe960e69546d93eb8d8bf0eda3b871dc830f6e35fde9329c07fc4", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03023_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04825636192271442, "origin_tokens": 10618, "compressed_tokens": 527, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10610, "source_tokens_receiver": 10610, "query_tokens": 629, "message_tokens": 527, "message_utf8_bytes": 2594, "cache_tensor_bytes": null, "serialized_payload_bytes": 2594, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.2882500076666, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.51062502898276, "ttft_ms": 13.47187499050051, "decode_ms": 13.528166920877993}, "total_wall_ms": 103.7569169420749, "ttft_ms": 13.47187499050051, "input_usage": {"receiver_prompt_tokens": 629}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6906723888, "mlx_cache_bytes": 977374452, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6906723888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03023_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cc31dfd4d29db2c64647304bbf99a4cd6578b571b4dfab52569d21c71c81fdd0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c1b713f73c5b32b4b85c7099", "attempt_id": "557cd2947c62", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:45.998490Z", "task_family": "synthetic", "document_id": "syn_03023_16000", "document_hash": "6dcdc8a309dbe960e69546d93eb8d8bf0eda3b871dc830f6e35fde9329c07fc4", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03023_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04825636192271442, "origin_tokens": 10618, "compressed_tokens": 527, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10610, "source_tokens_receiver": 10610, "query_tokens": 625, "message_tokens": 527, "message_utf8_bytes": 2594, "cache_tensor_bytes": null, "serialized_payload_bytes": 2594, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.2882500076666, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.79341689031571, "ttft_ms": 13.578291982412338, "decode_ms": 26.8278339644894}, "total_wall_ms": 116.4377920795232, "ttft_ms": 13.578291982412338, "input_usage": {"receiver_prompt_tokens": 625}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873480732, "mlx_cache_bytes": 977374452, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6873480732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03023_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cc31dfd4d29db2c64647304bbf99a4cd6578b571b4dfab52569d21c71c81fdd0", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 13400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "50c366e1940ab9177e170227", "attempt_id": "615744cfd9d5", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:46.149325Z", "task_family": "synthetic", "document_id": "syn_03023_16000", "document_hash": "6dcdc8a309dbe960e69546d93eb8d8bf0eda3b871dc830f6e35fde9329c07fc4", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03023_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04825636192271442, "origin_tokens": 10618, "compressed_tokens": 527, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10610, "source_tokens_receiver": 10610, "query_tokens": 634, "message_tokens": 527, "message_utf8_bytes": 2594, "cache_tensor_bytes": null, "serialized_payload_bytes": 2594, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.2882500076666, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.95170801505446, "ttft_ms": 13.488249969668686, "decode_ms": 13.649209053255618}, "total_wall_ms": 104.28883298300207, "ttft_ms": 13.488249969668686, "input_usage": {"receiver_prompt_tokens": 634}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6878117436, "mlx_cache_bytes": 1355421400, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6878117436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03023_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cc31dfd4d29db2c64647304bbf99a4cd6578b571b4dfab52569d21c71c81fdd0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "590e0dcd056deeac7cb8819e", "attempt_id": "0cbe0c361ee0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:46.424841Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27932351336606653, "origin_tokens": 1833, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1833, "source_tokens_receiver": 1833, "query_tokens": 711, "message_tokens": 613, "message_utf8_bytes": 2142, "cache_tensor_bytes": null, "serialized_payload_bytes": 2142, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.4354169666767, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.97245805058628, "ttft_ms": 13.667916995473206, "decode_ms": 94.47820798959583}, "total_wall_ms": 191.3930419832468, "ttft_ms": 13.667916995473206, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9840164864, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 512935024, "process_rss_bytes": 9840164864}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SL-19R-1587", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d78d8dace006e33e059a919ff31b33bf55d5af65c2d11a526374f38be78a09f7", "output_hash": "ec443ee9d09f3481154034f1fcaa81f8a0ac5dfe9dc889f6ac12c061317d403c"} | ||||
| 13402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "cc6825c8811e73c8e6d65563", "attempt_id": "292c9f6deb2c", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:46.638766Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27932351336606653, "origin_tokens": 1833, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1833, "source_tokens_receiver": 1833, "query_tokens": 716, "message_tokens": 613, "message_utf8_bytes": 2142, "cache_tensor_bytes": null, "serialized_payload_bytes": 2142, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.4354169666767, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.31883305031806, "ttft_ms": 13.571374933235347, "decode_ms": 108.38358395267278}, "total_wall_ms": 204.60933295544237, "ttft_ms": 13.571374933235347, "input_usage": {"receiver_prompt_tokens": 716}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925746052, "mlx_cache_bytes": 939954076, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6925746052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 134-P, Amos.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d78d8dace006e33e059a919ff31b33bf55d5af65c2d11a526374f38be78a09f7", "output_hash": "deaa4a7027da752c9df504fa0aa3bf6e95e67899555e909632c92824be0f9222"} | ||||
| 13403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "adefa2deecab0081dc78dc53", "attempt_id": "114f1b594e70", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:46.864841Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27932351336606653, "origin_tokens": 1833, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1833, "source_tokens_receiver": 1833, "query_tokens": 716, "message_tokens": 613, "message_utf8_bytes": 2142, "cache_tensor_bytes": null, "serialized_payload_bytes": 2142, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.4354169666767, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.01712504867464, "ttft_ms": 13.389915926381946, "decode_ms": 13.874542084522545}, "total_wall_ms": 109.49125001206994, "ttft_ms": 13.389915926381946, "input_usage": {"receiver_prompt_tokens": 716}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925746052, "mlx_cache_bytes": 939954076, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6925746052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d78d8dace006e33e059a919ff31b33bf55d5af65c2d11a526374f38be78a09f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "58209169f68cce43a488d550", "attempt_id": "360df5b252f5", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:46.996633Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27932351336606653, "origin_tokens": 1833, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1833, "source_tokens_receiver": 1833, "query_tokens": 711, "message_tokens": 613, "message_utf8_bytes": 2142, "cache_tensor_bytes": null, "serialized_payload_bytes": 2142, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.4354169666767, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.81633294932544, "ttft_ms": 13.509792042896152, "decode_ms": 81.05787495151162}, "total_wall_ms": 176.611041999422, "ttft_ms": 13.509792042896152, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 939954076, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d78d8dace006e33e059a919ff31b33bf55d5af65c2d11a526374f38be78a09f7", "output_hash": "1229d1ed4affff1edfd9decf0ca81f0878696c321c9db8e985142b3abb89f8b7"} | ||||
| 13405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7feaa039484ead467810eeeb", "attempt_id": "45e210854b45", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:47.194608Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27932351336606653, "origin_tokens": 1833, "compressed_tokens": 613, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1833, "source_tokens_receiver": 1833, "query_tokens": 718, "message_tokens": 613, "message_utf8_bytes": 2142, "cache_tensor_bytes": null, "serialized_payload_bytes": 2142, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.4354169666767, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.99699998274446, "ttft_ms": 13.48858408164233, "decode_ms": 27.141917031258345}, "total_wall_ms": 122.85466690082103, "ttft_ms": 13.48858408164233, "input_usage": {"receiver_prompt_tokens": 718}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6926303116, "mlx_cache_bytes": 1151507152, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6926303116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "480 CAD", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d78d8dace006e33e059a919ff31b33bf55d5af65c2d11a526374f38be78a09f7", "output_hash": "2b805cb377c063cf2055242d5de3dd1126def1234967fc60006e24b1b06b332a"} | ||||
| 13406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9abd11c3b8ac762fb4bb75f2", "attempt_id": "c95270b3fdf8", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:47.759295Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0908768193113241, "origin_tokens": 5634, "compressed_tokens": 617, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5634, "source_tokens_receiver": 5634, "query_tokens": 715, "message_tokens": 617, "message_utf8_bytes": 2952, "cache_tensor_bytes": null, "serialized_payload_bytes": 2952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.9149580411613, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.61091699730605, "ttft_ms": 13.524874928407371, "decode_ms": 94.51966593042016}, "total_wall_ms": 191.04845798574388, "ttft_ms": 13.524874928407371, "input_usage": {"receiver_prompt_tokens": 715}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9840164864, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924664704, "mlx_cache_bytes": 515114112, "process_rss_bytes": 9840164864}, "peak_prefill_memory": null, "peak_decode_memory": 6924664704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NG-69D-5055", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "404b731a8575063a81e5e38e8bd821338f027d573652e3ec80b60b986ff7abbd", "output_hash": "2ad4f1f569357ac4cbdf0624ef9ad5e94d4a7d597c597837c734d5d4da55d0dd"} | ||||
| 13407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "dfafe2afd8b8c3933079e24d", "attempt_id": "ea911f021807", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:47.978105Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0908768193113241, "origin_tokens": 5634, "compressed_tokens": 617, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5634, "source_tokens_receiver": 5634, "query_tokens": 720, "message_tokens": 617, "message_utf8_bytes": 2952, "cache_tensor_bytes": null, "serialized_payload_bytes": 2952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.9149580411613, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.44462504424155, "ttft_ms": 13.576624915003777, "decode_ms": 121.90050003118813}, "total_wall_ms": 218.31916691735387, "ttft_ms": 13.576624915003777, "input_usage": {"receiver_prompt_tokens": 720}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927564692, "mlx_cache_bytes": 917475260, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6927564692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Schefferville, Lot 522-C", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "404b731a8575063a81e5e38e8bd821338f027d573652e3ec80b60b986ff7abbd", "output_hash": "8e230870319ae61dbdfd5664ec2b1ed39a40ec61b8edf5980da3d84c1a655882"} | ||||
| 13408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2bfbcfde3c00851ac6db3c78", "attempt_id": "eee2405e7716", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:48.223802Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0908768193113241, "origin_tokens": 5634, "compressed_tokens": 617, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5634, "source_tokens_receiver": 5634, "query_tokens": 721, "message_tokens": 617, "message_utf8_bytes": 2952, "cache_tensor_bytes": null, "serialized_payload_bytes": 2952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.9149580411613, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.92516707256436, "ttft_ms": 13.54108308441937, "decode_ms": 13.529791962355375}, "total_wall_ms": 109.31995802093297, "ttft_ms": 13.54108308441937, "input_usage": {"receiver_prompt_tokens": 721}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927744920, "mlx_cache_bytes": 1059035900, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6927744920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "404b731a8575063a81e5e38e8bd821338f027d573652e3ec80b60b986ff7abbd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8f892761583dac6eaf692f56", "attempt_id": "855900478aca", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:48.360660Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0908768193113241, "origin_tokens": 5634, "compressed_tokens": 617, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5634, "source_tokens_receiver": 5634, "query_tokens": 717, "message_tokens": 617, "message_utf8_bytes": 2952, "cache_tensor_bytes": null, "serialized_payload_bytes": 2952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.9149580411613, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.48191701527685, "ttft_ms": 13.454459025524557, "decode_ms": 13.507333002053201}, "total_wall_ms": 108.67391701322049, "ttft_ms": 13.454459025524557, "input_usage": {"receiver_prompt_tokens": 717}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6903119752, "mlx_cache_bytes": 1248221948, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6903119752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "404b731a8575063a81e5e38e8bd821338f027d573652e3ec80b60b986ff7abbd", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 13410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "31db8a6ee0f7ffb829495fc3", "attempt_id": "c51a665ae542", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:48.496460Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0908768193113241, "origin_tokens": 5634, "compressed_tokens": 617, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5634, "source_tokens_receiver": 5634, "query_tokens": 723, "message_tokens": 617, "message_utf8_bytes": 2952, "cache_tensor_bytes": null, "serialized_payload_bytes": 2952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 416.9149580411613, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.5575000597164, "ttft_ms": 13.447250006720424, "decode_ms": 13.338083983398974}, "total_wall_ms": 109.6970000071451, "ttft_ms": 13.447250006720424, "input_usage": {"receiver_prompt_tokens": 723}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840181248, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6929301408, "mlx_cache_bytes": 1678911044, "process_rss_bytes": 9840181248}, "peak_prefill_memory": null, "peak_decode_memory": 6929301408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "404b731a8575063a81e5e38e8bd821338f027d573652e3ec80b60b986ff7abbd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "552468de83ad91230b23f29a", "attempt_id": "b1983c75c3a4", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:49.407805Z", "task_family": "synthetic", "document_id": "syn_03026_16000", "document_hash": "16c8741af11a355d207f63d30067b8376744c2d9886524e13f6592b2412b89ce", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03026_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047311033080761414, "origin_tokens": 10822, "compressed_tokens": 528, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10822, "source_tokens_receiver": 10822, "query_tokens": 626, "message_tokens": 528, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 769.4615829968825, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.80779201816767, "ttft_ms": 13.639832963235676, "decode_ms": 13.537125079892576}, "total_wall_ms": 104.29962491616607, "ttft_ms": 13.639832963235676, "input_usage": {"receiver_prompt_tokens": 626}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840230400, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873480732, "mlx_cache_bytes": 462471964, "process_rss_bytes": 9840230400}, "peak_prefill_memory": null, "peak_decode_memory": 6873480732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03026_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f293cf0e8232489b408513f9199e05af8fe06295b648d7d24435892d46d85598", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "88b87b2e8feb343a424e8f85", "attempt_id": "804ce772d4fe", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:49.546827Z", "task_family": "synthetic", "document_id": "syn_03026_16000", "document_hash": "16c8741af11a355d207f63d30067b8376744c2d9886524e13f6592b2412b89ce", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03026_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047311033080761414, "origin_tokens": 10822, "compressed_tokens": 528, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10822, "source_tokens_receiver": 10822, "query_tokens": 631, "message_tokens": 528, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 769.4615829968825, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.55904192849994, "ttft_ms": 13.68779200129211, "decode_ms": 13.602416031062603}, "total_wall_ms": 104.0435410104692, "ttft_ms": 13.68779200129211, "input_usage": {"receiver_prompt_tokens": 631}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840246784, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876184112, "mlx_cache_bytes": 815238388, "process_rss_bytes": 9840246784}, "peak_prefill_memory": null, "peak_decode_memory": 6876184112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03026_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f293cf0e8232489b408513f9199e05af8fe06295b648d7d24435892d46d85598", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e896205b2466a75435936a5e", "attempt_id": "88ebb38c1a48", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:49.685085Z", "task_family": "synthetic", "document_id": "syn_03026_16000", "document_hash": "16c8741af11a355d207f63d30067b8376744c2d9886524e13f6592b2412b89ce", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03026_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047311033080761414, "origin_tokens": 10822, "compressed_tokens": 528, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10822, "source_tokens_receiver": 10822, "query_tokens": 633, "message_tokens": 528, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 769.4615829968825, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.22250001784414, "ttft_ms": 13.600584003143013, "decode_ms": 13.921833015047014}, "total_wall_ms": 103.97058399394155, "ttft_ms": 13.600584003143013, "input_usage": {"receiver_prompt_tokens": 633}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840246784, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876741176, "mlx_cache_bytes": 1001625300, "process_rss_bytes": 9840246784}, "peak_prefill_memory": null, "peak_decode_memory": 6876741176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03026_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f293cf0e8232489b408513f9199e05af8fe06295b648d7d24435892d46d85598", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9d24b601a631d76bc7bf716e", "attempt_id": "71ac50df7e4f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:49.823907Z", "task_family": "synthetic", "document_id": "syn_03026_16000", "document_hash": "16c8741af11a355d207f63d30067b8376744c2d9886524e13f6592b2412b89ce", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03026_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047311033080761414, "origin_tokens": 10822, "compressed_tokens": 528, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10822, "source_tokens_receiver": 10822, "query_tokens": 627, "message_tokens": 528, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 769.4615829968825, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.89858299959451, "ttft_ms": 13.727667042985559, "decode_ms": 54.534583003260195}, "total_wall_ms": 144.43699992261827, "ttft_ms": 13.727667042985559, "input_usage": {"receiver_prompt_tokens": 627}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9840246784, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6873660976, "mlx_cache_bytes": 1124701908, "process_rss_bytes": 9840246784}, "peak_prefill_memory": null, "peak_decode_memory": 6873660976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03026_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f293cf0e8232489b408513f9199e05af8fe06295b648d7d24435892d46d85598", "output_hash": "09a3340bff29e5ae0e2d4e8898f50d337fa18c4442051ad06a03107e439c7460"} | ||||
| 13415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d2a837b0d59a420f71b4b02b", "attempt_id": "102dab05b33d", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.002221Z", "task_family": "synthetic", "document_id": "syn_03026_16000", "document_hash": "16c8741af11a355d207f63d30067b8376744c2d9886524e13f6592b2412b89ce", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03026_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047311033080761414, "origin_tokens": 10822, "compressed_tokens": 528, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10822, "source_tokens_receiver": 10822, "query_tokens": 634, "message_tokens": 528, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 769.4615829968825, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.35758293326944, "ttft_ms": 13.893791940063238, "decode_ms": 13.900541933253407}, "total_wall_ms": 105.40545801632106, "ttft_ms": 13.893791940063238, "input_usage": {"receiver_prompt_tokens": 634}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840246784, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6878117436, "mlx_cache_bytes": 1502748856, "process_rss_bytes": 9840246784}, "peak_prefill_memory": null, "peak_decode_memory": 6878117436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03026_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f293cf0e8232489b408513f9199e05af8fe06295b648d7d24435892d46d85598", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "415ef8a2ca423b70bab4c6dd", "attempt_id": "06c92ca9f9a0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.278344Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2909090909090909, "origin_tokens": 1760, "compressed_tokens": 620, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1760, "source_tokens_receiver": 1760, "query_tokens": 717, "message_tokens": 620, "message_utf8_bytes": 2241, "cache_tensor_bytes": null, "serialized_payload_bytes": 2241, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.15395906101912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.66408399119973, "ttft_ms": 13.802708010189235, "decode_ms": 107.78725007548928}, "total_wall_ms": 204.54204198904335, "ttft_ms": 13.802708010189235, "input_usage": {"receiver_prompt_tokens": 717}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840263168, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6925926280, "mlx_cache_bytes": 516408456, "process_rss_bytes": 9840263168}, "peak_prefill_memory": null, "peak_decode_memory": 6925926280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RQ-10W-4229", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "bb00d1dc7a4c2f147d4b8b46e8ee40800b9d2dce1386ebbc8ae2a3c3d50a3053", "output_hash": "83e9983dc82dee9d853925393e38c21ef13d0e07a7356398b84c1047f4e54bc9"} | ||||
| 13417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "88f45c548acb52f6032846e7", "attempt_id": "64af72286413", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.504794Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2909090909090909, "origin_tokens": 1760, "compressed_tokens": 620, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1760, "source_tokens_receiver": 1760, "query_tokens": 724, "message_tokens": 620, "message_utf8_bytes": 2241, "cache_tensor_bytes": null, "serialized_payload_bytes": 2241, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.15395906101912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.48041693493724, "ttft_ms": 13.583666062913835, "decode_ms": 13.392750057391822}, "total_wall_ms": 109.70204102341086, "ttft_ms": 13.583666062913835, "input_usage": {"receiver_prompt_tokens": 724}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930382756, "mlx_cache_bytes": 948195284, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6930382756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "bb00d1dc7a4c2f147d4b8b46e8ee40800b9d2dce1386ebbc8ae2a3c3d50a3053", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9ac5fdd38c2865258867dd73", "attempt_id": "8da4db9e07ad", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.637059Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2909090909090909, "origin_tokens": 1760, "compressed_tokens": 620, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1760, "source_tokens_receiver": 1760, "query_tokens": 723, "message_tokens": 620, "message_utf8_bytes": 2241, "cache_tensor_bytes": null, "serialized_payload_bytes": 2241, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.15395906101912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.24749998003244, "ttft_ms": 13.530500000342727, "decode_ms": 13.438457972370088}, "total_wall_ms": 108.58245892450213, "ttft_ms": 13.530500000342727, "input_usage": {"receiver_prompt_tokens": 723}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6906609560, "mlx_cache_bytes": 961515476, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6906609560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "bb00d1dc7a4c2f147d4b8b46e8ee40800b9d2dce1386ebbc8ae2a3c3d50a3053", "output_hash": "e629fa6598d732768f7c726b4b621285f9c3b85303900aa912017db7617d8bdb"} | ||||
| 13419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "acdce8f7dda6650c8bbce92b", "attempt_id": "133b97c43fa1", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.766855Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2909090909090909, "origin_tokens": 1760, "compressed_tokens": 620, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1760, "source_tokens_receiver": 1760, "query_tokens": 719, "message_tokens": 620, "message_utf8_bytes": 2241, "cache_tensor_bytes": null, "serialized_payload_bytes": 2241, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.15395906101912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.00962510798126, "ttft_ms": 13.431417057290673, "decode_ms": 13.461999944411218}, "total_wall_ms": 109.08183304127306, "ttft_ms": 13.431417057290673, "input_usage": {"receiver_prompt_tokens": 719}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6927220644, "mlx_cache_bytes": 1354633172, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6927220644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "bb00d1dc7a4c2f147d4b8b46e8ee40800b9d2dce1386ebbc8ae2a3c3d50a3053", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8b4d2303b49bbc2c94389cbc", "attempt_id": "bc2a65b7ab54", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:50.897460Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2909090909090909, "origin_tokens": 1760, "compressed_tokens": 620, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1760, "source_tokens_receiver": 1760, "query_tokens": 730, "message_tokens": 620, "message_utf8_bytes": 2241, "cache_tensor_bytes": null, "serialized_payload_bytes": 2241, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.15395906101912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.61275007296354, "ttft_ms": 13.83558299858123, "decode_ms": 13.63058399874717}, "total_wall_ms": 110.37570796906948, "ttft_ms": 13.83558299858123, "input_usage": {"receiver_prompt_tokens": 730}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6933757884, "mlx_cache_bytes": 1789893432, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6933757884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "535", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "bb00d1dc7a4c2f147d4b8b46e8ee40800b9d2dce1386ebbc8ae2a3c3d50a3053", "output_hash": "20ca98162ba780883712eb701c84e4c06f73aba78e903935a9ad799193b4627f"} | ||||
| 13421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "df75aed65d2d24573e12db72", "attempt_id": "cf4e36be305f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:51.444602Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 691, "message_tokens": 594, "message_utf8_bytes": 2869, "cache_tensor_bytes": null, "serialized_payload_bytes": 2869, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.21029190253466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.6205000737682, "ttft_ms": 13.588542002253234, "decode_ms": 13.47133400849998}, "total_wall_ms": 110.09258299600333, "ttft_ms": 13.588542002253234, "input_usage": {"receiver_prompt_tokens": 691}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840263168, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6910754592, "mlx_cache_bytes": 500810784, "process_rss_bytes": 9840263168}, "peak_prefill_memory": null, "peak_decode_memory": 6910754592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b01a2c114b7798f1d2dccfa91982bda5e54bbf75797900f644cc8b54e7f78a30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d879ab5f66e28cc486607e50", "attempt_id": "6e850b9994ed", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:51.582725Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 697, "message_tokens": 594, "message_utf8_bytes": 2869, "cache_tensor_bytes": null, "serialized_payload_bytes": 2869, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.21029190253466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.25595794990659, "ttft_ms": 13.415624969638884, "decode_ms": 13.44066602177918}, "total_wall_ms": 109.43779197987169, "ttft_ms": 13.415624969638884, "input_usage": {"receiver_prompt_tokens": 697}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 889949952, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b01a2c114b7798f1d2dccfa91982bda5e54bbf75797900f644cc8b54e7f78a30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "32762727c79c42ef1195b03e", "attempt_id": "287e38004250", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:51.719351Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 696, "message_tokens": 594, "message_utf8_bytes": 2869, "cache_tensor_bytes": null, "serialized_payload_bytes": 2869, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.21029190253466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.7560000102967, "ttft_ms": 13.496584026142955, "decode_ms": 13.801875058561563}, "total_wall_ms": 109.31887500919402, "ttft_ms": 13.496584026142955, "input_usage": {"receiver_prompt_tokens": 696}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6913834808, "mlx_cache_bytes": 889949952, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6913834808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b01a2c114b7798f1d2dccfa91982bda5e54bbf75797900f644cc8b54e7f78a30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "3f17ab92dfb53fdef22eb067", "attempt_id": "d54c13be157b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:51.856534Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 693, "message_tokens": 594, "message_utf8_bytes": 2869, "cache_tensor_bytes": null, "serialized_payload_bytes": 2869, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.21029190253466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.58737497776747, "ttft_ms": 13.507166993804276, "decode_ms": 13.47187499050051}, "total_wall_ms": 108.82874997332692, "ttft_ms": 13.507166993804276, "input_usage": {"receiver_prompt_tokens": 693}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6946766648, "mlx_cache_bytes": 1136627456, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6946766648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b01a2c114b7798f1d2dccfa91982bda5e54bbf75797900f644cc8b54e7f78a30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "caa8e6401282b1b4b412ef23", "attempt_id": "654c23534fbf", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:51.992501Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09139593002499108, "origin_tokens": 5602, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 701, "message_tokens": 594, "message_utf8_bytes": 2869, "cache_tensor_bytes": null, "serialized_payload_bytes": 2869, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.21029190253466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.33449999149889, "ttft_ms": 13.627209002152085, "decode_ms": 13.453958905301988}, "total_wall_ms": 109.8394999280572, "ttft_ms": 13.627209002152085, "input_usage": {"receiver_prompt_tokens": 701}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6916652872, "mlx_cache_bytes": 1554307568, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6916652872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b01a2c114b7798f1d2dccfa91982bda5e54bbf75797900f644cc8b54e7f78a30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "a0773860d6fe163f2eb07642", "attempt_id": "7d58e94f7615", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:52.897675Z", "task_family": "synthetic", "document_id": "syn_03029_16000", "document_hash": "33a51b6333419ddfbd88b362df2ee28a833f90300d55ae736740de8a07e5f525", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03029_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0477211296486159, "origin_tokens": 10729, "compressed_tokens": 541, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10729, "source_tokens_receiver": 10729, "query_tokens": 640, "message_tokens": 541, "message_utf8_bytes": 2573, "cache_tensor_bytes": null, "serialized_payload_bytes": 2573, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.4832499790937, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.09095790050924, "ttft_ms": 14.052583021111786, "decode_ms": 13.379666022956371}, "total_wall_ms": 105.83979194052517, "ttft_ms": 14.052583021111786, "input_usage": {"receiver_prompt_tokens": 640}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6881197652, "mlx_cache_bytes": 470418260, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6881197652, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03029_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9e8ea60b9e3d981f7af1e216df81e2c88d5f6bbb07a84f36cf765c6c9a1535f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "6d0b7401ff5de3c44912e118", "attempt_id": "5dadce576c7c", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.039116Z", "task_family": "synthetic", "document_id": "syn_03029_16000", "document_hash": "33a51b6333419ddfbd88b362df2ee28a833f90300d55ae736740de8a07e5f525", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03029_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0477211296486159, "origin_tokens": 10729, "compressed_tokens": 541, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10729, "source_tokens_receiver": 10729, "query_tokens": 645, "message_tokens": 541, "message_utf8_bytes": 2573, "cache_tensor_bytes": null, "serialized_payload_bytes": 2573, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.4832499790937, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.44937492720783, "ttft_ms": 13.580416911281645, "decode_ms": 13.692417065612972}, "total_wall_ms": 108.00554195884615, "ttft_ms": 13.580416911281645, "input_usage": {"receiver_prompt_tokens": 645}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6884195944, "mlx_cache_bytes": 854723940, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6884195944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03029_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9e8ea60b9e3d981f7af1e216df81e2c88d5f6bbb07a84f36cf765c6c9a1535f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "71653f2116dce73f56b3133b", "attempt_id": "bd74b215c8e3", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.181024Z", "task_family": "synthetic", "document_id": "syn_03029_16000", "document_hash": "33a51b6333419ddfbd88b362df2ee28a833f90300d55ae736740de8a07e5f525", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03029_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0477211296486159, "origin_tokens": 10729, "compressed_tokens": 541, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10729, "source_tokens_receiver": 10729, "query_tokens": 644, "message_tokens": 541, "message_utf8_bytes": 2573, "cache_tensor_bytes": null, "serialized_payload_bytes": 2573, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.4832499790937, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.12958401720971, "ttft_ms": 13.464667019434273, "decode_ms": 13.57449998613447}, "total_wall_ms": 107.42024995852262, "ttft_ms": 13.464667019434273, "input_usage": {"receiver_prompt_tokens": 644}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6884195944, "mlx_cache_bytes": 854723940, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6884195944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03029_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9e8ea60b9e3d981f7af1e216df81e2c88d5f6bbb07a84f36cf765c6c9a1535f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e646f5e235bfaf36d20d61ec", "attempt_id": "b9668d454ac2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.324797Z", "task_family": "synthetic", "document_id": "syn_03029_16000", "document_hash": "33a51b6333419ddfbd88b362df2ee28a833f90300d55ae736740de8a07e5f525", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03029_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0477211296486159, "origin_tokens": 10729, "compressed_tokens": 541, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10729, "source_tokens_receiver": 10729, "query_tokens": 640, "message_tokens": 541, "message_utf8_bytes": 2573, "cache_tensor_bytes": null, "serialized_payload_bytes": 2573, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.4832499790937, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.27433398738503, "ttft_ms": 13.488708063960075, "decode_ms": 13.489583972841501}, "total_wall_ms": 104.48366694618016, "ttft_ms": 13.488708063960075, "input_usage": {"receiver_prompt_tokens": 640}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6881197652, "mlx_cache_bytes": 854723940, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6881197652, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03029_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9e8ea60b9e3d981f7af1e216df81e2c88d5f6bbb07a84f36cf765c6c9a1535f5", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 13430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e6920a559faecd1e1693aa02", "attempt_id": "123306cfd8c8", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.463315Z", "task_family": "synthetic", "document_id": "syn_03029_16000", "document_hash": "33a51b6333419ddfbd88b362df2ee28a833f90300d55ae736740de8a07e5f525", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03029_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0477211296486159, "origin_tokens": 10729, "compressed_tokens": 541, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10729, "source_tokens_receiver": 10729, "query_tokens": 652, "message_tokens": 541, "message_utf8_bytes": 2573, "cache_tensor_bytes": null, "serialized_payload_bytes": 2573, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.4832499790937, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.59583296906203, "ttft_ms": 13.63545807544142, "decode_ms": 13.57841701246798}, "total_wall_ms": 108.05675003211945, "ttft_ms": 13.63545807544142, "input_usage": {"receiver_prompt_tokens": 652}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6888652420, "mlx_cache_bytes": 1243600784, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6888652420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03029_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9e8ea60b9e3d981f7af1e216df81e2c88d5f6bbb07a84f36cf765c6c9a1535f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8d2047b4fa891f00e64a7fbd", "attempt_id": "e86b670f6553", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.742013Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 626, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 725, "message_tokens": 626, "message_utf8_bytes": 2292, "cache_tensor_bytes": null, "serialized_payload_bytes": 2292, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.82733398955315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.78150001913309, "ttft_ms": 13.804542017169297, "decode_ms": 94.61670904420316}, "total_wall_ms": 191.6185829322785, "ttft_ms": 13.804542017169297, "input_usage": {"receiver_prompt_tokens": 725}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930562984, "mlx_cache_bytes": 521176232, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6930562984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SA-99X-5582", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "82285f0e0a4727359abeb71c3bb59cd804e81ee3c25395bf55aea8e271536f03", "output_hash": "418e2d2419844e55a0e0d5a5f62c9bf90dbe137bd83c679e009533943498d1a0"} | ||||
| 13432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "b02f8b795691ff5523c0de54", "attempt_id": "7d9c74dbbeb3", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:53.955427Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 626, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 730, "message_tokens": 626, "message_utf8_bytes": 2292, "cache_tensor_bytes": null, "serialized_payload_bytes": 2292, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.82733398955315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.88349998090416, "ttft_ms": 13.670917018316686, "decode_ms": 107.2561249602586}, "total_wall_ms": 204.09170899074525, "ttft_ms": 13.670917018316686, "input_usage": {"receiver_prompt_tokens": 730}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6933757884, "mlx_cache_bytes": 956436492, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6933757884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Mont-Laurier, Lot 503", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "82285f0e0a4727359abeb71c3bb59cd804e81ee3c25395bf55aea8e271536f03", "output_hash": "c7998dbe5b8512dd6aced45462e8a59b334a492c931635304a693b390f9d10e7"} | ||||
| 13433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8d5e9e74bb3fcba528caf324", "attempt_id": "a165140f6043", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:54.181538Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 626, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 728, "message_tokens": 626, "message_utf8_bytes": 2292, "cache_tensor_bytes": null, "serialized_payload_bytes": 2292, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.82733398955315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.81433305051178, "ttft_ms": 13.572332914918661, "decode_ms": 67.11520894896239}, "total_wall_ms": 162.72391693200916, "ttft_ms": 13.572332914918661, "input_usage": {"receiver_prompt_tokens": 728}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6909198256, "mlx_cache_bytes": 1088966668, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6909198256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4. 8545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "82285f0e0a4727359abeb71c3bb59cd804e81ee3c25395bf55aea8e271536f03", "output_hash": "d011ddefade78a099dac57c22a5d63ac79969904e35217daa27e3d85a27a178e"} | ||||
| 13434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "22418ac780dfc3d371fba25b", "attempt_id": "e277c2961250", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:54.365993Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 626, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 724, "message_tokens": 626, "message_utf8_bytes": 2292, "cache_tensor_bytes": null, "serialized_payload_bytes": 2292, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.82733398955315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.25974994618446, "ttft_ms": 13.364500016905367, "decode_ms": 80.36454196553677}, "total_wall_ms": 176.28699995111674, "ttft_ms": 13.364500016905367, "input_usage": {"receiver_prompt_tokens": 724}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930562984, "mlx_cache_bytes": 1088966668, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6930562984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lorcan Bergström", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "82285f0e0a4727359abeb71c3bb59cd804e81ee3c25395bf55aea8e271536f03", "output_hash": "5ca17fb7c0572a4d8bdf0553d246da8b09a69151cf9bbab90a1d2f650e36cdea"} | ||||
| 13435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "348428fd3f2e94e190d7c271", "attempt_id": "2da0a8ca7a75", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:54.564187Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 626, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 733, "message_tokens": 626, "message_utf8_bytes": 2292, "cache_tensor_bytes": null, "serialized_payload_bytes": 2292, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.82733398955315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.11841701995581, "ttft_ms": 13.432541978545487, "decode_ms": 13.475166982971132}, "total_wall_ms": 110.27216596994549, "ttft_ms": 13.432541978545487, "input_usage": {"receiver_prompt_tokens": 733}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935199688, "mlx_cache_bytes": 1498585980, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6935199688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "82285f0e0a4727359abeb71c3bb59cd804e81ee3c25395bf55aea8e271536f03", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "4bd5b982f0bef2149d25c4f6", "attempt_id": "ef5c762a645d", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:55.112176Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09103840682788052, "origin_tokens": 5624, "compressed_tokens": 605, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5624, "source_tokens_receiver": 5624, "query_tokens": 703, "message_tokens": 605, "message_utf8_bytes": 2857, "cache_tensor_bytes": null, "serialized_payload_bytes": 2857, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.60670802835375, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.09837495815009, "ttft_ms": 13.603791943751276, "decode_ms": 13.374999980442226}, "total_wall_ms": 110.42516701854765, "ttft_ms": 13.603791943751276, "input_usage": {"receiver_prompt_tokens": 703}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840279552, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6917914448, "mlx_cache_bytes": 508167248, "process_rss_bytes": 9840279552}, "peak_prefill_memory": null, "peak_decode_memory": 6917914448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "1a04f55a1c031973556b715d30bee826838ed1e0da0f915034350eb24c3587a8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "34df4f63caaedb53e9003e20", "attempt_id": "b0206e3d6787", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:55.250578Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09103840682788052, "origin_tokens": 5624, "compressed_tokens": 605, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5624, "source_tokens_receiver": 5624, "query_tokens": 711, "message_tokens": 605, "message_utf8_bytes": 2857, "cache_tensor_bytes": null, "serialized_payload_bytes": 2857, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.60670802835375, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.1516250250861, "ttft_ms": 13.49241693969816, "decode_ms": 13.611291069537401}, "total_wall_ms": 109.55529101192951, "ttft_ms": 13.49241693969816, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 931909480, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "1a04f55a1c031973556b715d30bee826838ed1e0da0f915034350eb24c3587a8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e0589a3cc63113464710c622", "attempt_id": "68479d40a8cc", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:55.387855Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09103840682788052, "origin_tokens": 5624, "compressed_tokens": 605, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5624, "source_tokens_receiver": 5624, "query_tokens": 708, "message_tokens": 605, "message_utf8_bytes": 2857, "cache_tensor_bytes": null, "serialized_payload_bytes": 2857, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.60670802835375, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.2339999936521, "ttft_ms": 13.568042078986764, "decode_ms": 26.95983392186463}, "total_wall_ms": 122.05270805861801, "ttft_ms": 13.568042078986764, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6898745188, "mlx_cache_bytes": 1060818792, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6898745188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "550.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "1a04f55a1c031973556b715d30bee826838ed1e0da0f915034350eb24c3587a8", "output_hash": "8ef9519f71b01f3a20b15900f176b5bd2963e361cafa5632e13761f2b93fec57"} | ||||
| 13439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e26d11144c382912cfd419d5", "attempt_id": "13c40d280b96", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:55.537264Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09103840682788052, "origin_tokens": 5624, "compressed_tokens": 605, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5624, "source_tokens_receiver": 5624, "query_tokens": 704, "message_tokens": 605, "message_utf8_bytes": 2857, "cache_tensor_bytes": null, "serialized_payload_bytes": 2857, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.60670802835375, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.09949994832277, "ttft_ms": 13.580792001448572, "decode_ms": 13.52383301127702}, "total_wall_ms": 109.52062497381121, "ttft_ms": 13.580792001448572, "input_usage": {"receiver_prompt_tokens": 704}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6918291312, "mlx_cache_bytes": 1268240232, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6918291312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "1a04f55a1c031973556b715d30bee826838ed1e0da0f915034350eb24c3587a8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c3b9617ba6f8944e672432fe", "attempt_id": "3e185cef87b2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:55.673740Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09103840682788052, "origin_tokens": 5624, "compressed_tokens": 605, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5624, "source_tokens_receiver": 5624, "query_tokens": 714, "message_tokens": 605, "message_utf8_bytes": 2857, "cache_tensor_bytes": null, "serialized_payload_bytes": 2857, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 410.60670802835375, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.15383295807987, "ttft_ms": 13.762957998551428, "decode_ms": 13.52870895061642}, "total_wall_ms": 109.80345797725022, "ttft_ms": 13.762957998551428, "input_usage": {"receiver_prompt_tokens": 714}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840295936, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6924484476, "mlx_cache_bytes": 1693964940, "process_rss_bytes": 9840295936}, "peak_prefill_memory": null, "peak_decode_memory": 6924484476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "1a04f55a1c031973556b715d30bee826838ed1e0da0f915034350eb24c3587a8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "96c8f3d79f42c0f8da2767cc", "attempt_id": "1b0d626021f6", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:56.572730Z", "task_family": "synthetic", "document_id": "syn_03032_16000", "document_hash": "7abde11ea4fef3545ad984c522190020d102fc4a8e95736bf23a72a9c7056a78", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03032_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04742936544696619, "origin_tokens": 10795, "compressed_tokens": 534, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10795, "source_tokens_receiver": 10795, "query_tokens": 633, "message_tokens": 534, "message_utf8_bytes": 2548, "cache_tensor_bytes": null, "serialized_payload_bytes": 2548, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 757.0011669304222, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.74883394408971, "ttft_ms": 13.809875003062189, "decode_ms": 13.460916001349688}, "total_wall_ms": 104.36491610016674, "ttft_ms": 13.809875003062189, "input_usage": {"receiver_prompt_tokens": 633}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840345088, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876741176, "mlx_cache_bytes": 465847096, "process_rss_bytes": 9840345088}, "peak_prefill_memory": null, "peak_decode_memory": 6876741176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03032_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "e9359ff81301dc1224342e864670bddf0ecd8796e375f0f38708558da3487f3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ec8b3e3d4e50f6c4112a41ca", "attempt_id": "4856d7a91ad0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:56.712493Z", "task_family": "synthetic", "document_id": "syn_03032_16000", "document_hash": "7abde11ea4fef3545ad984c522190020d102fc4a8e95736bf23a72a9c7056a78", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03032_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04742936544696619, "origin_tokens": 10795, "compressed_tokens": 534, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10795, "source_tokens_receiver": 10795, "query_tokens": 638, "message_tokens": 534, "message_utf8_bytes": 2548, "cache_tensor_bytes": null, "serialized_payload_bytes": 2548, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 757.0011669304222, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.27741596661508, "ttft_ms": 13.424583012238145, "decode_ms": 13.462667004205287}, "total_wall_ms": 104.39195798244327, "ttft_ms": 13.424583012238145, "input_usage": {"receiver_prompt_tokens": 638}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840361472, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879936076, "mlx_cache_bytes": 845778220, "process_rss_bytes": 9840361472}, "peak_prefill_memory": null, "peak_decode_memory": 6879936076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03032_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "e9359ff81301dc1224342e864670bddf0ecd8796e375f0f38708558da3487f3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "eab8c0d14e53e2d3e6cb594e", "attempt_id": "de61e1c747cc", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:56.850947Z", "task_family": "synthetic", "document_id": "syn_03032_16000", "document_hash": "7abde11ea4fef3545ad984c522190020d102fc4a8e95736bf23a72a9c7056a78", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03032_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04742936544696619, "origin_tokens": 10795, "compressed_tokens": 534, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10795, "source_tokens_receiver": 10795, "query_tokens": 637, "message_tokens": 534, "message_utf8_bytes": 2548, "cache_tensor_bytes": null, "serialized_payload_bytes": 2548, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 757.0011669304222, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.73487493209541, "ttft_ms": 13.475167099386454, "decode_ms": 13.569875038228929}, "total_wall_ms": 104.04175007715821, "ttft_ms": 13.475167099386454, "input_usage": {"receiver_prompt_tokens": 637}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840361472, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879936076, "mlx_cache_bytes": 845778220, "process_rss_bytes": 9840361472}, "peak_prefill_memory": null, "peak_decode_memory": 6879936076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03032_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "e9359ff81301dc1224342e864670bddf0ecd8796e375f0f38708558da3487f3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "45176195cf630a1b68781bc0", "attempt_id": "a6a2a78a9691", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:56.990724Z", "task_family": "synthetic", "document_id": "syn_03032_16000", "document_hash": "7abde11ea4fef3545ad984c522190020d102fc4a8e95736bf23a72a9c7056a78", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03032_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04742936544696619, "origin_tokens": 10795, "compressed_tokens": 534, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10795, "source_tokens_receiver": 10795, "query_tokens": 634, "message_tokens": 534, "message_utf8_bytes": 2548, "cache_tensor_bytes": null, "serialized_payload_bytes": 2548, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 757.0011669304222, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.06466708239168, "ttft_ms": 13.43041704967618, "decode_ms": 13.668791041709483}, "total_wall_ms": 104.34995894320309, "ttft_ms": 13.43041704967618, "input_usage": {"receiver_prompt_tokens": 634}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840361472, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6909984332, "mlx_cache_bytes": 1071549740, "process_rss_bytes": 9840361472}, "peak_prefill_memory": null, "peak_decode_memory": 6909984332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03032_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "e9359ff81301dc1224342e864670bddf0ecd8796e375f0f38708558da3487f3e", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 13445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "25107b9146b5fb08a1f21e9c", "attempt_id": "c09dcb653368", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:57.130217Z", "task_family": "synthetic", "document_id": "syn_03032_16000", "document_hash": "7abde11ea4fef3545ad984c522190020d102fc4a8e95736bf23a72a9c7056a78", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03032_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04742936544696619, "origin_tokens": 10795, "compressed_tokens": 534, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10795, "source_tokens_receiver": 10795, "query_tokens": 644, "message_tokens": 534, "message_utf8_bytes": 2548, "cache_tensor_bytes": null, "serialized_payload_bytes": 2548, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 757.0011669304222, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.18929099105299, "ttft_ms": 13.667166931554675, "decode_ms": 13.35033297073096}, "total_wall_ms": 107.51825000625104, "ttft_ms": 13.667166931554675, "input_usage": {"receiver_prompt_tokens": 644}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840361472, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6884015716, "mlx_cache_bytes": 1455658808, "process_rss_bytes": 9840361472}, "peak_prefill_memory": null, "peak_decode_memory": 6884015716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03032_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "e9359ff81301dc1224342e864670bddf0ecd8796e375f0f38708558da3487f3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "6673f3430266f59add09b59b", "attempt_id": "88d527f2ee57", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:57.409417Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 634, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 731, "message_tokens": 634, "message_utf8_bytes": 2282, "cache_tensor_bytes": null, "serialized_payload_bytes": 2282, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.1765419561416, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.20633398741484, "ttft_ms": 13.867625035345554, "decode_ms": 108.0306670628488}, "total_wall_ms": 205.42333310004324, "ttft_ms": 13.867625035345554, "input_usage": {"receiver_prompt_tokens": 731}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840377856, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6933938112, "mlx_cache_bytes": 524649664, "process_rss_bytes": 9840377856}, "peak_prefill_memory": null, "peak_decode_memory": 6933938112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "TQ-37Z-3885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "22b029412c562f0269a9c337e5e17f9c293f711ba58ff6d0400118c28e909acf", "output_hash": "a9fc9678b963b7c3d6778c275b5aeffc61762adbe622c0b7221038130b0f941f"} | ||||
| 13447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "84fc6775e511f25f41d0c97d", "attempt_id": "09718cd158a9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:57.637531Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 634, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 739, "message_tokens": 634, "message_utf8_bytes": 2282, "cache_tensor_bytes": null, "serialized_payload_bytes": 2282, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.1765419561416, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.65445905271918, "ttft_ms": 13.586874934844673, "decode_ms": 13.363665901124477}, "total_wall_ms": 110.88970908895135, "ttft_ms": 13.586874934844673, "input_usage": {"receiver_prompt_tokens": 739}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6938574816, "mlx_cache_bytes": 964874312, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6938574816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "22b029412c562f0269a9c337e5e17f9c293f711ba58ff6d0400118c28e909acf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ed0c8821f49c3e9b53552a1d", "attempt_id": "a4385fdffbc9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:57.770470Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 634, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 738, "message_tokens": 634, "message_utf8_bytes": 2282, "cache_tensor_bytes": null, "serialized_payload_bytes": 2282, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.1765419561416, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.50058302655816, "ttft_ms": 13.590125017799437, "decode_ms": 67.3183329636231}, "total_wall_ms": 164.6535419858992, "ttft_ms": 13.590125017799437, "input_usage": {"receiver_prompt_tokens": 738}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6938574816, "mlx_cache_bytes": 964874312, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6938574816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22. 7060", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "22b029412c562f0269a9c337e5e17f9c293f711ba58ff6d0400118c28e909acf", "output_hash": "2d4874815c4c532c44367c82f877b61826303a1dc26751e461514ebf534aae65"} | ||||
| 13449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7da3898afc1bf65278c1efcc", "attempt_id": "9d7930936174", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:57.956762Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 634, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 734, "message_tokens": 634, "message_utf8_bytes": 2282, "cache_tensor_bytes": null, "serialized_payload_bytes": 2282, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.1765419561416, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.90087496768683, "ttft_ms": 13.72554199770093, "decode_ms": 93.89891603495926}, "total_wall_ms": 190.8632500562817, "ttft_ms": 13.72554199770093, "input_usage": {"receiver_prompt_tokens": 734}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935576544, "mlx_cache_bytes": 1374883912, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6935576544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nnamdi Baptiste-Roy", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "22b029412c562f0269a9c337e5e17f9c293f711ba58ff6d0400118c28e909acf", "output_hash": "0828367789e6648fa24fa6e3bfce339a5b9721a26940345b1dc8f263207eb1e6"} | ||||
| 13450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "82d80ec090221df4c6f45f72", "attempt_id": "b2f511eb1b27", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:58.169529Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 634, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 742, "message_tokens": 634, "message_utf8_bytes": 2282, "cache_tensor_bytes": null, "serialized_payload_bytes": 2282, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.1765419561416, "decode_payload_ms": 0.0, "receiver_prefill_ms": 83.1801249878481, "ttft_ms": 13.595332973636687, "decode_ms": 67.58608401287347}, "total_wall_ms": 165.65354203339666, "ttft_ms": 13.595332973636687, "input_usage": {"receiver_prompt_tokens": 742}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6940213228, "mlx_cache_bytes": 1789369308, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6940213228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,326,886", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "22b029412c562f0269a9c337e5e17f9c293f711ba58ff6d0400118c28e909acf", "output_hash": "e3010154fffa148727cf0089dd15f522da80a70472d3718942ebc33c8f37eecd"} | ||||
| 13451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1ff1f3a5a37c0a5f2e083441", "attempt_id": "e93e18bad224", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:58.772656Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0899666139518538, "origin_tokens": 5691, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5691, "source_tokens_receiver": 5691, "query_tokens": 642, "message_tokens": 543, "message_utf8_bytes": 2703, "cache_tensor_bytes": null, "serialized_payload_bytes": 2703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.1555829877034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.98666604887694, "ttft_ms": 13.581667095422745, "decode_ms": 13.393667060881853}, "total_wall_ms": 107.31004201807082, "ttft_ms": 13.581667095422745, "input_usage": {"receiver_prompt_tokens": 642}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840377856, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6882754140, "mlx_cache_bytes": 472007516, "process_rss_bytes": 9840377856}, "peak_prefill_memory": null, "peak_decode_memory": 6882754140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5f9c29c7db97c77bea62e84bd642f35357ccbbd3384862cb855ef46a2682d7f3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "4366064328eb42bfb035109f", "attempt_id": "5461453e1ec0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:58.908063Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0899666139518538, "origin_tokens": 5691, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5691, "source_tokens_receiver": 5691, "query_tokens": 647, "message_tokens": 543, "message_utf8_bytes": 2703, "cache_tensor_bytes": null, "serialized_payload_bytes": 2703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.1555829877034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.00062494445592, "ttft_ms": 13.524458045139909, "decode_ms": 241.64066603407264}, "total_wall_ms": 335.48191690351814, "ttft_ms": 13.524458045139909, "input_usage": {"receiver_prompt_tokens": 647}, "output_usage": {"output_tokens": 18}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6885457520, "mlx_cache_bytes": 833719668, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6885457520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varostnov-2, BB-41K-8261, Val-d'Or", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5f9c29c7db97c77bea62e84bd642f35357ccbbd3384862cb855ef46a2682d7f3", "output_hash": "cbf89dd82f9bbcf3d31d5e1fa64ef45316cdda2a0fd10afc03774e742f42ab5c"} | ||||
| 13453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d643f813deaee081295dfdaa", "attempt_id": "86dc51878d94", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:59.270545Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0899666139518538, "origin_tokens": 5691, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5691, "source_tokens_receiver": 5691, "query_tokens": 647, "message_tokens": 543, "message_utf8_bytes": 2703, "cache_tensor_bytes": null, "serialized_payload_bytes": 2703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.1555829877034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.62979196943343, "ttft_ms": 13.567832997068763, "decode_ms": 13.466042000800371}, "total_wall_ms": 106.90404195338488, "ttft_ms": 13.567832997068763, "input_usage": {"receiver_prompt_tokens": 647}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6885457520, "mlx_cache_bytes": 833719668, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6885457520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5f9c29c7db97c77bea62e84bd642f35357ccbbd3384862cb855ef46a2682d7f3", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 13454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2993c98337989f773738e6d8", "attempt_id": "154bd20eda6b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:59.405127Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0899666139518538, "origin_tokens": 5691, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5691, "source_tokens_receiver": 5691, "query_tokens": 642, "message_tokens": 543, "message_utf8_bytes": 2703, "cache_tensor_bytes": null, "serialized_payload_bytes": 2703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.1555829877034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.65412498358637, "ttft_ms": 13.704583048820496, "decode_ms": 13.473792001605034}, "total_wall_ms": 107.0594999473542, "ttft_ms": 13.704583048820496, "input_usage": {"receiver_prompt_tokens": 642}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6882754140, "mlx_cache_bytes": 833719668, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6882754140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5f9c29c7db97c77bea62e84bd642f35357ccbbd3384862cb855ef46a2682d7f3", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 13455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "11ced7f4f15ccdb8d2d90551", "attempt_id": "73433c4969f3", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:41:59.539959Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0899666139518538, "origin_tokens": 5691, "compressed_tokens": 543, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5691, "source_tokens_receiver": 5691, "query_tokens": 650, "message_tokens": 543, "message_utf8_bytes": 2703, "cache_tensor_bytes": null, "serialized_payload_bytes": 2703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.1555829877034, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.2115000076592, "ttft_ms": 13.662290992215276, "decode_ms": 13.317208038643003}, "total_wall_ms": 107.44683304801583, "ttft_ms": 13.662290992215276, "input_usage": {"receiver_prompt_tokens": 650}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840394240, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6887390844, "mlx_cache_bytes": 1221302168, "process_rss_bytes": 9840394240}, "peak_prefill_memory": null, "peak_decode_memory": 6887390844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5f9c29c7db97c77bea62e84bd642f35357ccbbd3384862cb855ef46a2682d7f3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "34415a815487c3f8ea0aba3a", "attempt_id": "666812d9ce60", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:00.446130Z", "task_family": "synthetic", "document_id": "syn_03035_16000", "document_hash": "064997fa150540eb6684d35dd32131128e1899950cf604209dd972d63383ea1a", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03035_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04752622296481945, "origin_tokens": 10773, "compressed_tokens": 518, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10773, "source_tokens_receiver": 10773, "query_tokens": 616, "message_tokens": 518, "message_utf8_bytes": 2551, "cache_tensor_bytes": null, "serialized_payload_bytes": 2551, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 767.918833065778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.965542065911, "ttft_ms": 13.663374935276806, "decode_ms": 13.316750060766935}, "total_wall_ms": 103.2798329833895, "ttft_ms": 13.663374935276806, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840427008, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6867287540, "mlx_cache_bytes": 456114932, "process_rss_bytes": 9840427008}, "peak_prefill_memory": null, "peak_decode_memory": 6867287540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03035_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "65596de1e609ad3b6ebde9d8a67f2bcd2a315249af8ff7c919d2961bf4b6e13e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9c2b842082b58863e92c0124", "attempt_id": "c2c8256e1054", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:00.584852Z", "task_family": "synthetic", "document_id": "syn_03035_16000", "document_hash": "064997fa150540eb6684d35dd32131128e1899950cf604209dd972d63383ea1a", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03035_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04752622296481945, "origin_tokens": 10773, "compressed_tokens": 518, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10773, "source_tokens_receiver": 10773, "query_tokens": 624, "message_tokens": 518, "message_utf8_bytes": 2551, "cache_tensor_bytes": null, "serialized_payload_bytes": 2551, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 767.918833065778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.59683406725526, "ttft_ms": 13.48850002977997, "decode_ms": 13.545625028200448}, "total_wall_ms": 103.9105000672862, "ttft_ms": 13.48850002977997, "input_usage": {"receiver_prompt_tokens": 624}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6871924244, "mlx_cache_bytes": 827804848, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6871924244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03035_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "65596de1e609ad3b6ebde9d8a67f2bcd2a315249af8ff7c919d2961bf4b6e13e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "23d066793a5ff3e4390654a0", "attempt_id": "5e0db8bb86e7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:00.723554Z", "task_family": "synthetic", "document_id": "syn_03035_16000", "document_hash": "064997fa150540eb6684d35dd32131128e1899950cf604209dd972d63383ea1a", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03035_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04752622296481945, "origin_tokens": 10773, "compressed_tokens": 518, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10773, "source_tokens_receiver": 10773, "query_tokens": 622, "message_tokens": 518, "message_utf8_bytes": 2551, "cache_tensor_bytes": null, "serialized_payload_bytes": 2551, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 767.918833065778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.61066707037389, "ttft_ms": 13.463292038068175, "decode_ms": 13.552790973335505}, "total_wall_ms": 102.7924589579925, "ttft_ms": 13.463292038068175, "input_usage": {"receiver_prompt_tokens": 622}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6902070804, "mlx_cache_bytes": 988073136, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6902070804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03035_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "65596de1e609ad3b6ebde9d8a67f2bcd2a315249af8ff7c919d2961bf4b6e13e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "230f9f9aa502a1cffd066da4", "attempt_id": "14cf84a737d9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:00.860715Z", "task_family": "synthetic", "document_id": "syn_03035_16000", "document_hash": "064997fa150540eb6684d35dd32131128e1899950cf604209dd972d63383ea1a", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03035_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04752622296481945, "origin_tokens": 10773, "compressed_tokens": 518, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10773, "source_tokens_receiver": 10773, "query_tokens": 619, "message_tokens": 518, "message_utf8_bytes": 2551, "cache_tensor_bytes": null, "serialized_payload_bytes": 2551, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 767.918833065778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.61195799987763, "ttft_ms": 13.43258295673877, "decode_ms": 13.573499978519976}, "total_wall_ms": 102.82150004059076, "ttft_ms": 13.43258295673877, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6880591380, "mlx_cache_bytes": 1307167920, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6880591380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03035_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "65596de1e609ad3b6ebde9d8a67f2bcd2a315249af8ff7c919d2961bf4b6e13e", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 13460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ed45edebc610decd0462db93", "attempt_id": "43677eef06d7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:00.997723Z", "task_family": "synthetic", "document_id": "syn_03035_16000", "document_hash": "064997fa150540eb6684d35dd32131128e1899950cf604209dd972d63383ea1a", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03035_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.04752622296481945, "origin_tokens": 10773, "compressed_tokens": 518, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10773, "source_tokens_receiver": 10773, "query_tokens": 628, "message_tokens": 518, "message_utf8_bytes": 2551, "cache_tensor_bytes": null, "serialized_payload_bytes": 2551, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 767.918833065778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.68441692274064, "ttft_ms": 13.642000034451485, "decode_ms": 13.45491607207805}, "total_wall_ms": 104.025415959768, "ttft_ms": 13.642000034451485, "input_usage": {"receiver_prompt_tokens": 628}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6874742308, "mlx_cache_bytes": 1681741436, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6874742308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03035_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "65596de1e609ad3b6ebde9d8a67f2bcd2a315249af8ff7c919d2961bf4b6e13e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "ad7326cd51ad89a8ccaed73c", "attempt_id": "b72075a56e1b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:01.272721Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2790190735694823, "origin_tokens": 1835, "compressed_tokens": 604, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1835, "source_tokens_receiver": 1835, "query_tokens": 703, "message_tokens": 604, "message_utf8_bytes": 2167, "cache_tensor_bytes": null, "serialized_payload_bytes": 2167, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.43970810435712, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.3544169543311, "ttft_ms": 13.76570900902152, "decode_ms": 13.448833022266626}, "total_wall_ms": 110.8102920698002, "ttft_ms": 13.76570900902152, "input_usage": {"receiver_prompt_tokens": 703}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840427008, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6917914448, "mlx_cache_bytes": 508167248, "process_rss_bytes": 9840427008}, "peak_prefill_memory": null, "peak_decode_memory": 6917914448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5b6ef6e1a7af6965203bd0a141fe23d8c8eee9cf3648a14efe3aba3f808d8eb5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "33a2029a3a6923165cc17193", "attempt_id": "c080c9cf2660", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:01.406221Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2790190735694823, "origin_tokens": 1835, "compressed_tokens": 604, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1835, "source_tokens_receiver": 1835, "query_tokens": 708, "message_tokens": 604, "message_utf8_bytes": 2167, "cache_tensor_bytes": null, "serialized_payload_bytes": 2167, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.43970810435712, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.16458402946591, "ttft_ms": 13.577790930867195, "decode_ms": 120.93758303672075}, "total_wall_ms": 216.93212504033, "ttft_ms": 13.577790930867195, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921109348, "mlx_cache_bytes": 930418524, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6921109348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 190-P, Schefferville.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5b6ef6e1a7af6965203bd0a141fe23d8c8eee9cf3648a14efe3aba3f808d8eb5", "output_hash": "3f4c2bbcf019ff281a0f01052261dbf4d5b100e6919d2ec4ca59a8240615f682"} | ||||
| 13463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "96904e3894120bf4b957d830", "attempt_id": "e6fd13850b54", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:01.644787Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2790190735694823, "origin_tokens": 1835, "compressed_tokens": 604, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1835, "source_tokens_receiver": 1835, "query_tokens": 708, "message_tokens": 604, "message_utf8_bytes": 2167, "cache_tensor_bytes": null, "serialized_payload_bytes": 2167, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.43970810435712, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.72737499605864, "ttft_ms": 13.500292086973786, "decode_ms": 13.433415908366442}, "total_wall_ms": 108.93016611225903, "ttft_ms": 13.500292086973786, "input_usage": {"receiver_prompt_tokens": 708}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6921109348, "mlx_cache_bytes": 930418524, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6921109348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5b6ef6e1a7af6965203bd0a141fe23d8c8eee9cf3648a14efe3aba3f808d8eb5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "a3ae07fb0684fbf45408e4fa", "attempt_id": "4c529c0d6ba0", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:01.775559Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2790190735694823, "origin_tokens": 1835, "compressed_tokens": 604, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1835, "source_tokens_receiver": 1835, "query_tokens": 702, "message_tokens": 604, "message_utf8_bytes": 2167, "cache_tensor_bytes": null, "serialized_payload_bytes": 2167, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.43970810435712, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.3998329686001, "ttft_ms": 13.618958066217601, "decode_ms": 40.36429105326533}, "total_wall_ms": 136.61749998573214, "ttft_ms": 13.618958066217601, "input_usage": {"receiver_prompt_tokens": 702}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6952353616, "mlx_cache_bytes": 973508444, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6952353616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Zelenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5b6ef6e1a7af6965203bd0a141fe23d8c8eee9cf3648a14efe3aba3f808d8eb5", "output_hash": "0e887b2fe7a59eb9ea519131c99c3e36e7f42de86c4bb6d35de360846f4b85d8"} | ||||
| 13465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "28ec2bc5626824866a8341c3", "attempt_id": "b0c13534b26b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:01.933403Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2790190735694823, "origin_tokens": 1835, "compressed_tokens": 604, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1835, "source_tokens_receiver": 1835, "query_tokens": 711, "message_tokens": 604, "message_utf8_bytes": 2167, "cache_tensor_bytes": null, "serialized_payload_bytes": 2167, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 132.43970810435712, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.33633295074105, "ttft_ms": 13.40850000269711, "decode_ms": 13.667750055901706}, "total_wall_ms": 109.67549995984882, "ttft_ms": 13.40850000269711, "input_usage": {"receiver_prompt_tokens": 711}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6922551152, "mlx_cache_bytes": 1371003508, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6922551152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "5b6ef6e1a7af6965203bd0a141fe23d8c8eee9cf3648a14efe3aba3f808d8eb5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "f9a7d2e4c010b4710d085ddb", "attempt_id": "0efddea83706", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:02.480643Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0891520111440014, "origin_tokens": 5743, "compressed_tokens": 532, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5743, "source_tokens_receiver": 5743, "query_tokens": 632, "message_tokens": 532, "message_utf8_bytes": 2689, "cache_tensor_bytes": null, "serialized_payload_bytes": 2689, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.94866597652435, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.81220904830843, "ttft_ms": 13.756125001236796, "decode_ms": 13.445125077851117}, "total_wall_ms": 104.40166597254574, "ttft_ms": 13.756125001236796, "input_usage": {"receiver_prompt_tokens": 632}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840427008, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 465650484, "process_rss_bytes": 9840427008}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3698140997a489e46700f95229e9ab32664da34012cc5f10613cceeae5fa6954", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2630c5da46fcbd44915e69b2", "attempt_id": "fc5a43532800", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:02.613422Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0891520111440014, "origin_tokens": 5743, "compressed_tokens": 532, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5743, "source_tokens_receiver": 5743, "query_tokens": 638, "message_tokens": 532, "message_utf8_bytes": 2689, "cache_tensor_bytes": null, "serialized_payload_bytes": 2689, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.94866597652435, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.2877919478342, "ttft_ms": 13.540165964514017, "decode_ms": 107.01845900621265}, "total_wall_ms": 198.12858302611858, "ttft_ms": 13.540165964514017, "input_usage": {"receiver_prompt_tokens": 638}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879936076, "mlx_cache_bytes": 845581608, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6879936076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 964-S, Matagami", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3698140997a489e46700f95229e9ab32664da34012cc5f10613cceeae5fa6954", "output_hash": "ea538f4a0811a39f3982dfe26dc9b5b09602ca06af3c187835bf7413f4fdb605"} | ||||
| 13468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "5ecae3a64c2d227f73eb0bdd", "attempt_id": "df1cf44a6130", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:02.838764Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0891520111440014, "origin_tokens": 5743, "compressed_tokens": 532, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5743, "source_tokens_receiver": 5743, "query_tokens": 636, "message_tokens": 532, "message_utf8_bytes": 2689, "cache_tensor_bytes": null, "serialized_payload_bytes": 2689, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.94866597652435, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.82120806910098, "ttft_ms": 13.526374939829111, "decode_ms": 13.37837497703731}, "total_wall_ms": 103.9563330123201, "ttft_ms": 13.526374939829111, "input_usage": {"receiver_prompt_tokens": 636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6879575628, "mlx_cache_bytes": 970427688, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6879575628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3698140997a489e46700f95229e9ab32664da34012cc5f10613cceeae5fa6954", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d21af5f133d37158ff201f37", "attempt_id": "1023de9bb064", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:02.969535Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0891520111440014, "origin_tokens": 5743, "compressed_tokens": 532, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5743, "source_tokens_receiver": 5743, "query_tokens": 631, "message_tokens": 532, "message_utf8_bytes": 2689, "cache_tensor_bytes": null, "serialized_payload_bytes": 2689, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.94866597652435, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.84120898880064, "ttft_ms": 13.391542015597224, "decode_ms": 13.378084055148065}, "total_wall_ms": 102.83104190602899, "ttft_ms": 13.391542015597224, "input_usage": {"receiver_prompt_tokens": 631}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6876560948, "mlx_cache_bytes": 970427688, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6876560948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3698140997a489e46700f95229e9ab32664da34012cc5f10613cceeae5fa6954", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "397142d513e85ca48f0c6bb4", "attempt_id": "3415c9c48020", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:03.099213Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0891520111440014, "origin_tokens": 5743, "compressed_tokens": 532, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5743, "source_tokens_receiver": 5743, "query_tokens": 644, "message_tokens": 532, "message_utf8_bytes": 2689, "cache_tensor_bytes": null, "serialized_payload_bytes": 2689, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 411.94866597652435, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.26074997521937, "ttft_ms": 13.608540990389884, "decode_ms": 13.29224999062717}, "total_wall_ms": 107.48920892365277, "ttft_ms": 13.608540990389884, "input_usage": {"receiver_prompt_tokens": 644}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6884015716, "mlx_cache_bytes": 1354536756, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6884015716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "3698140997a489e46700f95229e9ab32664da34012cc5f10613cceeae5fa6954", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "1b423cf9ab9d189ce96d4a7f", "attempt_id": "03d28b97cd80", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.002409Z", "task_family": "synthetic", "document_id": "syn_03038_16000", "document_hash": "5a11b0be7f9c210d91d212d00d966eecee65de0dd5d102b6647df2938b7c7326", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03038_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047561542034370644, "origin_tokens": 10765, "compressed_tokens": 519, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10765, "source_tokens_receiver": 10765, "query_tokens": 616, "message_tokens": 519, "message_utf8_bytes": 2562, "cache_tensor_bytes": null, "serialized_payload_bytes": 2562, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.1654580365866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.04791603423655, "ttft_ms": 13.745958916842937, "decode_ms": 13.571582967415452}, "total_wall_ms": 103.64579095039517, "ttft_ms": 13.745958916842937, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6867287540, "mlx_cache_bytes": 456114932, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6867287540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03038_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8e9195add14717369c9d97998420c3dae007ebd335b115ef5543d6341aa5bcff", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "91a0bda06506e136cdcb52b8", "attempt_id": "b04a4a7541fd", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.141757Z", "task_family": "synthetic", "document_id": "syn_03038_16000", "document_hash": "5a11b0be7f9c210d91d212d00d966eecee65de0dd5d102b6647df2938b7c7326", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03038_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047561542034370644, "origin_tokens": 10765, "compressed_tokens": 519, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10765, "source_tokens_receiver": 10765, "query_tokens": 623, "message_tokens": 519, "message_utf8_bytes": 2562, "cache_tensor_bytes": null, "serialized_payload_bytes": 2562, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.1654580365866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.98450006823987, "ttft_ms": 13.635457959026098, "decode_ms": 13.491249992512167}, "total_wall_ms": 103.35683298762888, "ttft_ms": 13.635457959026098, "input_usage": {"receiver_prompt_tokens": 623}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6871547408, "mlx_cache_bytes": 827411628, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6871547408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03038_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8e9195add14717369c9d97998420c3dae007ebd335b115ef5543d6341aa5bcff", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "52ad536b5666b93b8ab1331a", "attempt_id": "e668d32781c2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.280361Z", "task_family": "synthetic", "document_id": "syn_03038_16000", "document_hash": "5a11b0be7f9c210d91d212d00d966eecee65de0dd5d102b6647df2938b7c7326", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03038_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047561542034370644, "origin_tokens": 10765, "compressed_tokens": 519, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10765, "source_tokens_receiver": 10765, "query_tokens": 622, "message_tokens": 519, "message_utf8_bytes": 2562, "cache_tensor_bytes": null, "serialized_payload_bytes": 2562, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.1654580365866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.68529103789479, "ttft_ms": 13.589374953880906, "decode_ms": 13.361250050365925}, "total_wall_ms": 102.84908290486783, "ttft_ms": 13.589374953880906, "input_usage": {"receiver_prompt_tokens": 622}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6902054416, "mlx_cache_bytes": 865586348, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6902054416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03038_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8e9195add14717369c9d97998420c3dae007ebd335b115ef5543d6341aa5bcff", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d15df9d6b296e8e2ef20f641", "attempt_id": "84dd780e2a79", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.418104Z", "task_family": "synthetic", "document_id": "syn_03038_16000", "document_hash": "5a11b0be7f9c210d91d212d00d966eecee65de0dd5d102b6647df2938b7c7326", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03038_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047561542034370644, "origin_tokens": 10765, "compressed_tokens": 519, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10765, "source_tokens_receiver": 10765, "query_tokens": 618, "message_tokens": 519, "message_utf8_bytes": 2562, "cache_tensor_bytes": null, "serialized_payload_bytes": 2562, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.1654580365866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.4053750531748, "ttft_ms": 13.544499990530312, "decode_ms": 26.735167019069195}, "total_wall_ms": 115.86870905011892, "ttft_ms": 13.544499990530312, "input_usage": {"receiver_prompt_tokens": 618}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6880411152, "mlx_cache_bytes": 1184484524, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6880411152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03038_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8e9195add14717369c9d97998420c3dae007ebd335b115ef5543d6341aa5bcff", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 13475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "21355648fbaadf6f96a8d2fc", "attempt_id": "0e1e2e5aea41", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.568867Z", "task_family": "synthetic", "document_id": "syn_03038_16000", "document_hash": "5a11b0be7f9c210d91d212d00d966eecee65de0dd5d102b6647df2938b7c7326", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03038_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.047561542034370644, "origin_tokens": 10765, "compressed_tokens": 519, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10765, "source_tokens_receiver": 10765, "query_tokens": 625, "message_tokens": 519, "message_utf8_bytes": 2562, "cache_tensor_bytes": null, "serialized_payload_bytes": 2562, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.1654580365866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.65016702190042, "ttft_ms": 13.610624941065907, "decode_ms": 13.432667008601129}, "total_wall_ms": 102.92975010816008, "ttft_ms": 13.610624941065907, "input_usage": {"receiver_prompt_tokens": 625}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6872104472, "mlx_cache_bytes": 1368512108, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6872104472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03038_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8e9195add14717369c9d97998420c3dae007ebd335b115ef5543d6341aa5bcff", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "04da7f30d5110f8a2aca1d06", "attempt_id": "cfb8655c4280", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.843024Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2942528735632184, "origin_tokens": 1740, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1740, "source_tokens_receiver": 1740, "query_tokens": 726, "message_tokens": 628, "message_utf8_bytes": 2316, "cache_tensor_bytes": null, "serialized_payload_bytes": 2316, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.05070903152227, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.89770800527185, "ttft_ms": 13.673500041477382, "decode_ms": 13.64233298227191}, "total_wall_ms": 110.50095909740776, "ttft_ms": 13.673500041477382, "input_usage": {"receiver_prompt_tokens": 726}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9840443392, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6930939820, "mlx_cache_bytes": 521569452, "process_rss_bytes": 9840443392}, "peak_prefill_memory": null, "peak_decode_memory": 6930939820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "7c353421857746c7497f12f5df703a5d3fcbdb4ea549bc94420b0c4b4509ebc2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7ac3e7fc7710e41082245dd0", "attempt_id": "0eed294fda42", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:04.976219Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2942528735632184, "origin_tokens": 1740, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1740, "source_tokens_receiver": 1740, "query_tokens": 732, "message_tokens": 628, "message_utf8_bytes": 2316, "cache_tensor_bytes": null, "serialized_payload_bytes": 2316, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.05070903152227, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.9255419773981, "ttft_ms": 13.768458971753716, "decode_ms": 148.1083749094978}, "total_wall_ms": 245.09454204235226, "ttft_ms": 13.768458971753716, "input_usage": {"receiver_prompt_tokens": 732}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935019460, "mlx_cache_bytes": 958124056, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6935019460, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 191-F, Baie-Comeau.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "7c353421857746c7497f12f5df703a5d3fcbdb4ea549bc94420b0c4b4509ebc2", "output_hash": "ef70e3faf7fbd0db92047de71c18d558816c8be121e161b7e5bfd81f0ccdb220"} | ||||
| 13478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c3fbf1b274a8031b42d4bd73", "attempt_id": "7369aac539be", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:05.243158Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2942528735632184, "origin_tokens": 1740, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1740, "source_tokens_receiver": 1740, "query_tokens": 731, "message_tokens": 628, "message_utf8_bytes": 2316, "cache_tensor_bytes": null, "serialized_payload_bytes": 2316, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.05070903152227, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.47354202810675, "ttft_ms": 13.51058401633054, "decode_ms": 67.16599990613759}, "total_wall_ms": 163.39929099194705, "ttft_ms": 13.51058401633054, "input_usage": {"receiver_prompt_tokens": 731}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6910984120, "mlx_cache_bytes": 971591704, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6910984120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "40. 2091", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "7c353421857746c7497f12f5df703a5d3fcbdb4ea549bc94420b0c4b4509ebc2", "output_hash": "f80d9ffb08311dbf3eb21bccb234522246266a13d7522fd03ee41f40c7c4d317"} | ||||
| 13479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "c246051512cf63373b65bf7d", "attempt_id": "4f5d40111c55", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:05.428912Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2942528735632184, "origin_tokens": 1740, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1740, "source_tokens_receiver": 1740, "query_tokens": 727, "message_tokens": 628, "message_utf8_bytes": 2316, "cache_tensor_bytes": null, "serialized_payload_bytes": 2316, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.05070903152227, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.97483299206942, "ttft_ms": 13.56324995867908, "decode_ms": 107.06000006757677}, "total_wall_ms": 202.90654199197888, "ttft_ms": 13.56324995867908, "input_usage": {"receiver_prompt_tokens": 727}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6931857348, "mlx_cache_bytes": 1297715224, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6931857348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Novnovnov-16, unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "7c353421857746c7497f12f5df703a5d3fcbdb4ea549bc94420b0c4b4509ebc2", "output_hash": "6c7015ec472a4d7b54bff9eaf7faf2e93a52140df508aba3be0126bd21ccbf4a"} | ||||
| 13480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2279a9a1f171d75ea4adf795", "attempt_id": "84da33b51997", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:05.653561Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2942528735632184, "origin_tokens": 1740, "compressed_tokens": 628, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1740, "source_tokens_receiver": 1740, "query_tokens": 734, "message_tokens": 628, "message_utf8_bytes": 2316, "cache_tensor_bytes": null, "serialized_payload_bytes": 2316, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.05070903152227, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.45424991380423, "ttft_ms": 13.736290973611176, "decode_ms": 40.23583303205669}, "total_wall_ms": 136.69674994889647, "ttft_ms": 13.736290973611176, "input_usage": {"receiver_prompt_tokens": 734}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9840459776, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6935576524, "mlx_cache_bytes": 1513986956, "process_rss_bytes": 9840459776}, "peak_prefill_memory": null, "peak_decode_memory": 6935576524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27,162", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "7c353421857746c7497f12f5df703a5d3fcbdb4ea549bc94420b0c4b4509ebc2", "output_hash": "ec1573760b33b4eb60e220b079dacf19ecc3d62bca9b0e512755dc719b322975"} | ||||
| 13481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "4c9c1ad4441c175fc02a0d85", "attempt_id": "610a4c293f7d", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:05.968289Z", "task_family": "exec", "document_id": "exec_00201_2000", "document_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00201_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2905788876276958, "origin_tokens": 1762, "compressed_tokens": 566, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1762, "source_tokens_receiver": 1762, "query_tokens": 672, "message_tokens": 566, "message_utf8_bytes": 2515, "cache_tensor_bytes": null, "serialized_payload_bytes": 2515, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 151.8884999677539, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.9616250442341, "ttft_ms": 13.48108402453363, "decode_ms": 1478.1810420099646}, "total_wall_ms": 1572.9792080819607, "ttft_ms": 13.48108402453363, "input_usage": {"receiver_prompt_tokens": 672}, "output_usage": {"output_tokens": 110}, "provider_cached_usage": null, "process_memory": 9840541696, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6899744468, "mlx_cache_bytes": 614269908, "process_rss_bytes": 9840541696}, "peak_prefill_memory": null, "peak_decode_memory": 6899744468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[5]:\n if row[0] < 4:\n total_price = row[1] * (1 - row[2] / 100)\n net_revenue += total_price\n else:\n net_revenue += row[1]\n else:\n net_revenue += row[1] * (1 - row[2] / 100)\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00201_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b2e1317c1951d683259b9938cbabc418e9c3046c6cd096768309656e6b4c6707", "output_hash": "62a6e672d1ce8c036eff5d2c6ec4249979c8945bf8b0c06faf5933e431a92bfd"} | ||||
| 13482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d6462df67d245a103683f8e0", "attempt_id": "c89abd5d5085", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:07.765260Z", "task_family": "exec", "document_id": "exec_00202_2000", "document_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00202_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2925714285714286, "origin_tokens": 1750, "compressed_tokens": 580, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1750, "source_tokens_receiver": 1750, "query_tokens": 687, "message_tokens": 580, "message_utf8_bytes": 2422, "cache_tensor_bytes": null, "serialized_payload_bytes": 2422, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.19750001095235, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.14566595759243, "ttft_ms": 13.436250039376318, "decode_ms": 1604.1294580791146}, "total_wall_ms": 1700.0405000289902, "ttft_ms": 13.436250039376318, "input_usage": {"receiver_prompt_tokens": 687}, "output_usage": {"output_tokens": 119}, "provider_cached_usage": null, "process_memory": 9840558080, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6908641040, "mlx_cache_bytes": 623412240, "process_rss_bytes": 9840558080}, "peak_prefill_memory": null, "peak_decode_memory": 6908641040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_price = 0\n return_dict = {}\n for row in rows:\n if row[3]:\n unit_price = row[2] * row[4]\n discount = row[2] * row[5]\n total_price += unit_price - discount\n return_dict[row[0]] = {\n 'total_price': unit_price - discount,\n 'return': round((unit_price - discount - row[6]) / unit_price * 100)\n }\n return total_price, return_dict\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00202_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "958baf63c26ecfa6416dda54aa3ad7996f19e75c27e510ebb03fd914e69b1667", "output_hash": "9c473ae01c753b0555e42f736b12b8b13772e7cb55fbd84879a274f50317fcc4"} | ||||
| 13483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fb6eae1b8228cb6c3a66c2d1", "attempt_id": "1a409805d1c7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:09.689477Z", "task_family": "exec", "document_id": "exec_00203_2000", "document_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00203_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 579, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 685, "message_tokens": 579, "message_utf8_bytes": 2433, "cache_tensor_bytes": null, "serialized_payload_bytes": 2433, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.28337500616908, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.12733298912644, "ttft_ms": 13.676374917849898, "decode_ms": 959.1150420019403}, "total_wall_ms": 1055.442874901928, "ttft_ms": 13.676374917849898, "input_usage": {"receiver_prompt_tokens": 685}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 9840558080, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6907379464, "mlx_cache_bytes": 497337352, "process_rss_bytes": 9840558080}, "peak_prefill_memory": null, "peak_decode_memory": 6907379464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_price = 0\n for row in rows:\n if row[3] < 5:\n continue\n unit_price = row[1] - (row[1] * row[2] / 100)\n total_price += unit_price\n return total_price\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00203_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b03918646d03efbe8088b0c87a0f6308fc2c637b6c68067e28ca13e1bf5b0973", "output_hash": "9c4f7528d4bad7234c8ac0e0afb2dbca5375c4105e1e511f00817bcd25097236"} | ||||
| 13484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "249692f5ce8f1d73a6740de8", "attempt_id": "fb51489c21df", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:10.966933Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2882882882882883, "origin_tokens": 1776, "compressed_tokens": 571, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1776, "source_tokens_receiver": 1776, "query_tokens": 677, "message_tokens": 571, "message_utf8_bytes": 2437, "cache_tensor_bytes": null, "serialized_payload_bytes": 2437, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.06537502352148, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.74979193042964, "ttft_ms": 13.673665933310986, "decode_ms": 1547.018332988955}, "total_wall_ms": 1642.768583027646, "ttft_ms": 13.673665933310986, "input_usage": {"receiver_prompt_tokens": 677}, "output_usage": {"output_tokens": 115}, "provider_cached_usage": null, "process_memory": 9840558080, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6902742760, "mlx_cache_bytes": 617350120, "process_rss_bytes": 9840558080}, "peak_prefill_memory": null, "peak_decode_memory": 6902742760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n total_price = row[1] * row[2]\n discount = total_price * row[3] / 100\n total_price -= discount\n tax = total_price * row[4] / 100\n total_price -= tax\n if row[5]:\n total_price -= total_price * row[6] / 100\n net_revenue.append([row[0], total_price])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b7473c9b2ca34ae2ad15a2f4942179c42282d616b583ea59fc5a9c9279c50de4", "output_hash": "3a25256cab462a5e1cb32c2c1077112ba4d284b7186c251430927e593e89675f"} | ||||
| 13485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fcffc2920a4be15dd5396dac", "attempt_id": "09276543f2ae", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:12.835175Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2879640044994376, "origin_tokens": 1778, "compressed_tokens": 578, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 684, "message_tokens": 578, "message_utf8_bytes": 2327, "cache_tensor_bytes": null, "serialized_payload_bytes": 2327, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.99858301319182, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.34491695091128, "ttft_ms": 13.695165980607271, "decode_ms": 2792.174707981758}, "total_wall_ms": 2888.588665984571, "ttft_ms": 13.695165980607271, "input_usage": {"receiver_prompt_tokens": 684}, "output_usage": {"output_tokens": 203}, "provider_cached_usage": null, "process_memory": 9840607232, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6907199236, "mlx_cache_bytes": 621921284, "process_rss_bytes": 9840607232}, "peak_prefill_memory": null, "peak_decode_memory": 6907199236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[3]:\n if row[2] < 2:\n net_revenue.append({\n 'revenue': row[0],\n 'unit_price': row[1],\n 'days': row[2],\n 'return': row[3],\n 'result': row[4]\n })\n else:\n discount = row[1] * row[4] / 100\n unit_price = row[1] - discount\n tax = unit_price * row[2] * row[4] / 100\n net_revenue.append({\n 'revenue': row[0] * row[4],\n 'unit_price': unit_price,\n 'days': row[2],\n 'return': row[3],\n 'result': row[4],\n 'tax': tax\n })\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "423a49a4accbb29d70f7498f3ebf493e0c0481ec1422a6875554275ac1745e8a", "output_hash": "a307b446a77dfaebc3d534f4333abf69203f14ae8a6eabb7ccb4cb5570ca3b0e"} | ||||
| 13486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8ba5551920d488af0ada35b4", "attempt_id": "a9fa9ad4ba9f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:15.948869Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2925714285714286, "origin_tokens": 1750, "compressed_tokens": 584, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1750, "source_tokens_receiver": 1750, "query_tokens": 690, "message_tokens": 584, "message_utf8_bytes": 2394, "cache_tensor_bytes": null, "serialized_payload_bytes": 2394, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.46862507797778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.24412503093481, "ttft_ms": 13.564125052653253, "decode_ms": 1656.4636249095201}, "total_wall_ms": 1752.6230829535052, "ttft_ms": 13.564125052653253, "input_usage": {"receiver_prompt_tokens": 690}, "output_usage": {"output_tokens": 123}, "provider_cached_usage": null, "process_memory": 9840607232, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6910574364, "mlx_cache_bytes": 625394716, "process_rss_bytes": 9840607232}, "peak_prefill_memory": null, "peak_decode_memory": 6910574364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[3] < 4:\n continue\n if row[3] < 4 and row[4] < 0:\n continue\n if row[4] < 0:\n net_revenue += row[2] * (1 - row[4])\n else:\n net_revenue += row[2] * (1 - row[4]) * (1 + row[4] / 100)\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "91535a844a7c8262e6f7eb2869f5f0ce078ee999e468a110e4336dff99f138d3", "output_hash": "1cd5a1a531494e01135bfff7b53b5e0ed8bcf8a7082638991c6dc75c3514efd9"} | ||||
modified
runs/raw/E4_core.jsonl
+975 −0
@@ -6223,3 +6223,978 @@ | |||||
| 6223 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b162f886218841a39399343c", "attempt_id": "e4e63600f593", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.169852Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 185.62729097902775, "ttft_ms": 11.925874976441264, "decode_ms": 47.405832912772894}, "total_wall_ms": 21964.225627016276, "ttft_ms": 11.925874976441264, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | 6223 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b162f886218841a39399343c", "attempt_id": "e4e63600f593", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.169852Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 185.62729097902775, "ttft_ms": 11.925874976441264, "decode_ms": 47.405832912772894}, "total_wall_ms": 21964.225627016276, "ttft_ms": 11.925874976441264, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||
| 6224 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb082e8097f0ee67f129a690", "attempt_id": "754476efbb71", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.429713Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 186.26170803327113, "ttft_ms": 11.866291984915733, "decode_ms": 11.894959025084972}, "total_wall_ms": 21929.25254406873, "ttft_ms": 11.866291984915733, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | 6224 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb082e8097f0ee67f129a690", "attempt_id": "754476efbb71", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.429713Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 186.26170803327113, "ttft_ms": 11.866291984915733, "decode_ms": 11.894959025084972}, "total_wall_ms": 21929.25254406873, "ttft_ms": 11.866291984915733, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||
| 6225 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89e13de313a27070f96961f5", "attempt_id": "1192f28acd67", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.655083Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 185.66583399660885, "ttft_ms": 11.722749914042652, "decode_ms": 11.803374974988401}, "total_wall_ms": 21928.473793086596, "ttft_ms": 11.722749914042652, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | 6225 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89e13de313a27070f96961f5", "attempt_id": "1192f28acd67", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.655083Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 185.66583399660885, "ttft_ms": 11.722749914042652, "decode_ms": 11.803374974988401}, "total_wall_ms": 21928.473793086596, "ttft_ms": 11.722749914042652, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||
| 6226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1f7aa4ac28db426e9462c704", "attempt_id": "509f0586ceb4", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:50.591976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 460, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.69120892789215, "ttft_ms": 11.868500034324825, "decode_ms": 11.89162500668317}, "total_wall_ms": 41637.12862704415, "ttft_ms": 11.868500034324825, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "30827b67cd75275a944ecfa3", "attempt_id": "4b956dd8efe7", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:50.817498Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.96262496430427, "ttft_ms": 11.96454104501754, "decode_ms": 11.789167067036033}, "total_wall_ms": 41637.3655020725, "ttft_ms": 11.96454104501754, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bcf0fac8f19bd29a06f64021", "attempt_id": "9dabebf42c6a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.042525Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 184.82099997345358, "ttft_ms": 11.880457983352244, "decode_ms": 12.16229097917676}, "total_wall_ms": 41636.48425193969, "ttft_ms": 11.880457983352244, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cd80899899222e560f14c4e9", "attempt_id": "78a54017cc1b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.266420Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 463, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.6077500851825, "ttft_ms": 11.889124987646937, "decode_ms": 11.934250011108816}, "total_wall_ms": 41637.05754408147, "ttft_ms": 11.889124987646937, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83ec9388a20a29c81d9609ee", "attempt_id": "332b65d6084c", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.491055Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.66837499383837, "ttft_ms": 11.86079194303602, "decode_ms": 11.88775000628084}, "total_wall_ms": 41637.0368769858, "ttft_ms": 11.86079194303602, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "30ffe3b485f5c222e3deccb5", "attempt_id": "d32427a19537", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.715250Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.16775004193187, "ttft_ms": 11.90533407498151, "decode_ms": 11.867707944475114}, "total_wall_ms": 41637.58175203111, "ttft_ms": 11.90533407498151, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2f0b7943918e7a32b5613d88", "attempt_id": "5bcda0480d37", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.940219Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 461, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 184.79249998927116, "ttft_ms": 11.864167056046426, "decode_ms": 11.8454999756068}, "total_wall_ms": 41636.138335918076, "ttft_ms": 11.864167056046426, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "05ffc38086f0787c6e85c95a", "attempt_id": "486fe2b6e0e0", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.163716Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 462, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.69795798975974, "ttft_ms": 11.89908292144537, "decode_ms": 11.869458016008139}, "total_wall_ms": 41637.0997519698, "ttft_ms": 11.89908292144537, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5b795e637a0776a0efff044b", "attempt_id": "4d2df655a5d0", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.387894Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.6634590551257, "ttft_ms": 11.852583033032715, "decode_ms": 11.909167049452662}, "total_wall_ms": 41638.05362698622, "ttft_ms": 11.852583033032715, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5ea45deb13726ba60308bfec", "attempt_id": "5623b1124162", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.612954Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.8509590383619, "ttft_ms": 11.948750005103648, "decode_ms": 11.846582987345755}, "total_wall_ms": 41637.2786690481, "ttft_ms": 11.948750005103648, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7b937c223f4ac6fb25e9cf4", "attempt_id": "16b457b0913a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.837790Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.66258396115154, "ttft_ms": 11.848125024698675, "decode_ms": 59.24800003413111}, "total_wall_ms": 41685.39125204552, "ttft_ms": 11.848125024698675, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 6237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "172399ef80b88f0477f16468", "attempt_id": "0e7ab39679a1", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.110680Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.79341599252075, "ttft_ms": 11.93629193585366, "decode_ms": 71.10645901411772}, "total_wall_ms": 41696.49600202683, "ttft_ms": 11.93629193585366, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "972465", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "0a00e59631ae965bf9ab3d3d1f18cb59d92aea878baa86f032ccec5b0696dce0"} | ||||
| 6238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c0cde1360a80dd776b398901", "attempt_id": "35867cd3df7c", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.394481Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.3639589389786, "ttft_ms": 12.168999994173646, "decode_ms": 47.6904169190675}, "total_wall_ms": 41673.04825200699, "ttft_ms": 12.168999994173646, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 6239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c4b0e4f592543159cb5475f6", "attempt_id": "6c18494121ad", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.655585Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.04341603349894, "ttft_ms": 12.104833964258432, "decode_ms": 12.137249927036464}, "total_wall_ms": 41638.14587704837, "ttft_ms": 12.104833964258432, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "185678dd0114cdb5fae5b0a9", "attempt_id": "267d568814ca", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.883722Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.3162920344621, "ttft_ms": 12.045166920870543, "decode_ms": 12.15504202991724}, "total_wall_ms": 41638.27246008441, "ttft_ms": 12.045166920870543, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "af0e42d0b1084fed64200fde", "attempt_id": "989677fd86d5", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:00.972787Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.402125088498, "ttft_ms": 12.21316703595221, "decode_ms": 11.887833010405302}, "total_wall_ms": 7111.151498975232, "ttft_ms": 12.21316703595221, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b2a09d16aff35ab7f9f40b15", "attempt_id": "db58afecd8ae", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:01.239208Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.97008401155472, "ttft_ms": 12.136540957726538, "decode_ms": 130.98520797211677}, "total_wall_ms": 7230.709374998696, "ttft_ms": 12.136540957726538, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 6243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da421a27d683d923570a3bc2", "attempt_id": "14e935e8b50a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:01.624983Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.0039999857545, "ttft_ms": 11.921084020286798, "decode_ms": 83.41558300890028}, "total_wall_ms": 7183.151665958576, "ttft_ms": 11.921084020286798, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 6244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "87baee15405fb7a62bff50d2", "attempt_id": "7d40e380956a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:01.962819Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.7918330617249, "ttft_ms": 12.025915901176631, "decode_ms": 47.71212500054389}, "total_wall_ms": 7147.156000020914, "ttft_ms": 12.025915901176631, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 6245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e23c03ec72a3a634e13ecf7e", "attempt_id": "f97a4fc05b84", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:02.265293Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.13754198048264, "ttft_ms": 12.27516692597419, "decode_ms": 12.184666004031897}, "total_wall_ms": 7112.408332992345, "ttft_ms": 12.27516692597419, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a55f5f9c37ddc26b42971966", "attempt_id": "44e010c85d45", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:02.533199Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.2484590066597, "ttft_ms": 12.140959035605192, "decode_ms": 131.11216691322625}, "total_wall_ms": 7231.239791959524, "ttft_ms": 12.140959035605192, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 6247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e0f9e0331ae77f1f3c4dcca6", "attempt_id": "16627c9a08a4", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:02.921271Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.95445804856718, "ttft_ms": 11.989000020548701, "decode_ms": 11.9677500333637}, "total_wall_ms": 7111.529208021238, "ttft_ms": 11.989000020548701, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eaf351a567901b5d636b7901", "attempt_id": "7c7a9334f070", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.188021Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.48525005206466, "ttft_ms": 12.032832950353622, "decode_ms": 11.912500020116568}, "total_wall_ms": 7111.016624025069, "ttft_ms": 12.032832950353622, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 6249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "451cfecc9918407050534893", "attempt_id": "74f1140d4484", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.453727Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 229.28704204969108, "ttft_ms": 12.16325000859797, "decode_ms": 12.026750016957521}, "total_wall_ms": 7114.078290993348, "ttft_ms": 12.16325000859797, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "378adc8a667fa8fddede73d1", "attempt_id": "45697d980867", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.722608Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.62954207044095, "ttft_ms": 11.946208076551557, "decode_ms": 12.06508302129805}, "total_wall_ms": 7111.226874985732, "ttft_ms": 11.946208076551557, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bd5b8288eb43fbc74778ca88", "attempt_id": "fe63c1a2ee72", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.988549Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 609, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.37750003580004, "ttft_ms": 11.970457970164716, "decode_ms": 59.540791902691126}, "total_wall_ms": 7159.483207971789, "ttft_ms": 11.970457970164716, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 6252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "693d6ee093db0ab9f80e4ef8", "attempt_id": "3467a640ac8a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:04.302529Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.26708301343024, "ttft_ms": 11.9785419665277, "decode_ms": 83.4002080373466}, "total_wall_ms": 7183.243583072908, "ttft_ms": 11.9785419665277, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1302481", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1c130ebf03e5051f031da47a49e8c91caae34e3c2144f451ec045a8e1c85549d"} | ||||
| 6253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f1dec0bdc802d2531d269fdc", "attempt_id": "b6562f2ad885", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:04.640930Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.34291695430875, "ttft_ms": 12.062499998137355, "decode_ms": 11.937125003896654}, "total_wall_ms": 7111.109748948365, "ttft_ms": 12.062499998137355, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "225aa0bdffe8ab7c68a1bc2d", "attempt_id": "1284cd7b8c1e", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:04.906734Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.39533400069922, "ttft_ms": 12.255124980583787, "decode_ms": 11.995458044111729}, "total_wall_ms": 7111.378874978982, "ttft_ms": 12.255124980583787, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c4f55ba6563dde2e253a68fa", "attempt_id": "74385a148ddf", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:05.172487Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.69262497220188, "ttft_ms": 12.230082997120917, "decode_ms": 12.032125028781593}, "total_wall_ms": 7111.5701659582555, "ttft_ms": 12.230082997120917, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d62a89297f31d2f14e52f08a", "attempt_id": "ec06dd215e7b", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:11.742463Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 577, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 209.32583301328123, "ttft_ms": 11.933750007301569, "decode_ms": 11.934750014916062}, "total_wall_ms": 13395.379541092552, "ttft_ms": 11.933750007301569, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7d7b6fdd2cccadcb17bc0a68", "attempt_id": "b476270061c4", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:11.991795Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 227.2348329424858, "ttft_ms": 11.93300005979836, "decode_ms": 130.301000084728}, "total_wall_ms": 13531.631125020795, "ttft_ms": 11.93300005979836, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 6258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1f38e6b02f18b205ce94701", "attempt_id": "15f50fe3a956", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:12.376929Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.3869169401005, "ttft_ms": 11.981499963440001, "decode_ms": 83.10983295086771}, "total_wall_ms": 13483.626958099194, "ttft_ms": 11.981499963440001, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 6259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb03c0eeb92823b5de9ce689", "attempt_id": "e193f3d41d46", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:12.713802Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 580, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.5225830487907, "ttft_ms": 11.911417008377612, "decode_ms": 11.882040998898447}, "total_wall_ms": 13412.46295813471, "ttft_ms": 11.911417008377612, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d68ae32727b36042d2ee7c59", "attempt_id": "61f45f0a2116", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:12.979220Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 587, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.67000000365078, "ttft_ms": 12.13691697921604, "decode_ms": 11.901833000592887}, "total_wall_ms": 13412.861917051487, "ttft_ms": 12.13691697921604, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "569e7bf5a4ec8f5c44cabea3", "attempt_id": "4d36945963de", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:13.245674Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 588, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.48012498393655, "ttft_ms": 11.998458998277783, "decode_ms": 131.08833401929587}, "total_wall_ms": 13531.844624085352, "ttft_ms": 11.998458998277783, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 6262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5439b7ea2f5d286c2f17ad45", "attempt_id": "7afd6978bee8", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:13.631115Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 578, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 225.67512502428144, "ttft_ms": 12.151958071626723, "decode_ms": 11.959291994571686}, "total_wall_ms": 13412.100958172232, "ttft_ms": 12.151958071626723, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ae060020ba2a575f6a79448", "attempt_id": "06ba95a72aba", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:13.896877Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 579, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 225.89400003198534, "ttft_ms": 12.093709083274007, "decode_ms": 11.991459061391652}, "total_wall_ms": 13412.250958150253, "ttft_ms": 12.093709083274007, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 6264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "555fcc2c0601b06b6ea40726", "attempt_id": "c21c08f7425e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:14.163548Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.92554094828665, "ttft_ms": 11.92904100753367, "decode_ms": 11.978833004832268}, "total_wall_ms": 13412.984083057381, "ttft_ms": 11.92904100753367, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea6d7b1a40375117ca4a8985", "attempt_id": "dfd858c8d46d", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:14.430204Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 586, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.34762490633875, "ttft_ms": 11.899958946742117, "decode_ms": 11.99108303990215}, "total_wall_ms": 13412.35208301805, "ttft_ms": 11.899958946742117, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "777c33c64131b7f6665fa222", "attempt_id": "f9d9d7fa3a7f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:14.695586Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.97137494105846, "ttft_ms": 11.974541936069727, "decode_ms": 59.44470898248255}, "total_wall_ms": 13460.535542108119, "ttft_ms": 11.974541936069727, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 6267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9808688b5da67796aa80fe81", "attempt_id": "1b41db8d342e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.009317Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.5684159938246, "ttft_ms": 11.967374943196774, "decode_ms": 94.82549992389977}, "total_wall_ms": 13495.493583148345, "ttft_ms": 11.967374943196774, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13024817", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "672c00df3bfd31225e9d03325d167c25800a9007589a430995bacbf8ad8c6f21"} | ||||
| 6268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "40c70859f27d25f58330e92b", "attempt_id": "73c2aa411d76", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.358163Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 585, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.84412507805973, "ttft_ms": 11.883749975822866, "decode_ms": 11.935291928239167}, "total_wall_ms": 13412.811083020642, "ttft_ms": 11.883749975822866, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f47aaff34d48a1545ac238ec", "attempt_id": "ec1a0206b938", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.625521Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.9573329249397, "ttft_ms": 11.8819170165807, "decode_ms": 11.953916982747614}, "total_wall_ms": 13412.913375068456, "ttft_ms": 11.8819170165807, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16b41f5139a790c73426beec", "attempt_id": "e0c079376663", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.891792Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.9875839119777, "ttft_ms": 11.907708016224205, "decode_ms": 11.941958917304873}, "total_wall_ms": 13412.956041051075, "ttft_ms": 11.907708016224205, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "47dbca824955d1ae3187b5b2", "attempt_id": "4b33b63e5bab", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:28.732598Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 577, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 208.80850008688867, "ttft_ms": 11.889124987646937, "decode_ms": 11.852832976728678}, "total_wall_ms": 25966.977458214387, "ttft_ms": 11.889124987646937, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5fbbe72094418704b950ce2c", "attempt_id": "2d751a26a233", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:28.980959Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.34654201101512, "ttft_ms": 11.926042032428086, "decode_ms": 130.3043330553919}, "total_wall_ms": 26102.99900022801, "ttft_ms": 11.926042032428086, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 6273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "636b1db17d7394fa10e4db7b", "attempt_id": "676086342928", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:29.365158Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.45491606090218, "ttft_ms": 12.106165988370776, "decode_ms": 82.95112499035895}, "total_wall_ms": 26055.92525016982, "ttft_ms": 12.106165988370776, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 6274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9752381593d9c22229f9dad1", "attempt_id": "634285066f0d", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:29.701866Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 580, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.81824991013855, "ttft_ms": 12.0340830180794, "decode_ms": 11.84329204261303}, "total_wall_ms": 25985.095583135262, "ttft_ms": 12.0340830180794, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0376c88c828bef134fbed9da", "attempt_id": "a2d2f553b9cf", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:29.967992Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 587, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.58925002906471, "ttft_ms": 11.893625021912158, "decode_ms": 12.020291993394494}, "total_wall_ms": 25984.889708226547, "ttft_ms": 11.893625021912158, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f3a2ad21e7faa465c057bd52", "attempt_id": "56135811360c", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:30.233621Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 588, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.74441698472947, "ttft_ms": 11.915334034711123, "decode_ms": 130.16837497707456}, "total_wall_ms": 26103.23541611433, "ttft_ms": 11.915334034711123, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 6277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a7e0415503bc1b18c154e71f", "attempt_id": "e2d867779f60", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:30.617805Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 578, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.10416694078594, "ttft_ms": 11.85033400543034, "decode_ms": 12.1004160027951}, "total_wall_ms": 25984.432583092712, "ttft_ms": 11.85033400543034, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "81cfa9d8f3ba1008aa6ebf45", "attempt_id": "2e2ab8e694c1", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:30.883044Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 579, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.06004192493856, "ttft_ms": 11.915459064766765, "decode_ms": 11.863666004501283}, "total_wall_ms": 25984.224875224754, "ttft_ms": 11.915459064766765, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 6279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "798d6eab719c01d6fa323a5d", "attempt_id": "cde957380797", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.148078Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.8334999680519, "ttft_ms": 11.853165924549103, "decode_ms": 11.917417054064572}, "total_wall_ms": 25985.012792167254, "ttft_ms": 11.853165924549103, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6f56a31eb6966de70cf5c503", "attempt_id": "c3315cc70b5f", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.414421Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 586, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.39208403415978, "ttft_ms": 11.858208919875324, "decode_ms": 11.979374918155372}, "total_wall_ms": 25984.62350014597, "ttft_ms": 11.858208919875324, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "673baaca5ce68b663c4407c9", "attempt_id": "2d060ba1290a", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.680363Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.7625000094995, "ttft_ms": 11.84979104436934, "decode_ms": 59.57145907450467}, "total_wall_ms": 26032.5781252468, "ttft_ms": 11.84979104436934, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 6282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bbd43850f5370d90b0173997", "attempt_id": "e3d42e35d164", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.993892Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.64541599806398, "ttft_ms": 11.909915949217975, "decode_ms": 95.06816603243351}, "total_wall_ms": 26068.139667157084, "ttft_ms": 11.909915949217975, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13024817", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "672c00df3bfd31225e9d03325d167c25800a9007589a430995bacbf8ad8c6f21"} | ||||
| 6283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab4374f3eb03b45bd89473a7", "attempt_id": "701953fa6c1b", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:32.342938Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 585, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 225.72845791000873, "ttft_ms": 12.108584051020443, "decode_ms": 11.9452920043841}, "total_wall_ms": 25984.325875062495, "ttft_ms": 12.108584051020443, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "028d9e49e3548ba4b7b15965", "attempt_id": "12e58e6b60d0", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:32.608407Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.51729197241366, "ttft_ms": 11.971124913543463, "decode_ms": 12.001250055618584}, "total_wall_ms": 25984.878625255078, "ttft_ms": 11.971124913543463, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bb7fcd436e6930e9dc5471f4", "attempt_id": "6c8911670c59", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:32.874665Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.58804105594754, "ttft_ms": 11.91033294890076, "decode_ms": 11.964667006395757}, "total_wall_ms": 25984.893624205142, "ttft_ms": 11.91033294890076, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e3fe79b117646c8676c65d0", "attempt_id": "fb80622b766e", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:58.272129Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 577, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 208.69258395396173, "ttft_ms": 11.884875013493001, "decode_ms": 11.874084011651576}, "total_wall_ms": 51093.529292033054, "ttft_ms": 11.884875013493001, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b99d21b2d0bfc02fbbefdcb8", "attempt_id": "a04ee8808f84", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:58.520777Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.50037507992238, "ttft_ms": 11.87854097224772, "decode_ms": 130.59416692703962}, "total_wall_ms": 51230.06037506275, "ttft_ms": 11.87854097224772, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 6288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fdb50f2b66efd8c03eeebc15", "attempt_id": "f04eb326e10a", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:58.905448Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.56700003426522, "ttft_ms": 11.946541955694556, "decode_ms": 82.96749996952713}, "total_wall_ms": 51182.533667073585, "ttft_ms": 11.946541955694556, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 6289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6d679d27a5f7afc5d3084456", "attempt_id": "4d333eabca8e", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:59.242133Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 580, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 225.9958341019228, "ttft_ms": 11.976291076280177, "decode_ms": 11.83108298573643}, "total_wall_ms": 51110.87299999781, "ttft_ms": 11.976291076280177, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c86d699770928bf84c3c791", "attempt_id": "ee4abff82877", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:59.507138Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 587, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.3192079262808, "ttft_ms": 12.070041964761913, "decode_ms": 11.930875014513731}, "total_wall_ms": 51111.36558302678, "ttft_ms": 12.070041964761913, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cfae9e6ec10ad8e3ded42592", "attempt_id": "121fceb1df67", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:59.772630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 588, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.77674994338304, "ttft_ms": 12.181833968497813, "decode_ms": 131.2990830047056}, "total_wall_ms": 51231.40708403662, "ttft_ms": 12.181833968497813, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 6292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7996816ebde05369c712c59d", "attempt_id": "a68ad8d9efb1", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.158309Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 578, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 225.8157500764355, "ttft_ms": 11.92099996842444, "decode_ms": 11.865791981108487}, "total_wall_ms": 51110.675751115195, "ttft_ms": 11.92099996842444, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49a0c8f91f796305ff856c8b", "attempt_id": "d34aa3289eb0", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.423596Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 579, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.30445798859, "ttft_ms": 12.106165988370776, "decode_ms": 11.934584006667137}, "total_wall_ms": 51111.38970812317, "ttft_ms": 12.106165988370776, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 6294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ea2c2bb519b47b7e2e55a3d", "attempt_id": "cfbf2567603c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.689159Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.98754200246185, "ttft_ms": 11.919333948753774, "decode_ms": 11.920499964617193}, "total_wall_ms": 51111.89204198308, "ttft_ms": 11.919333948753774, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0167a7006f01719d616eb409", "attempt_id": "f61a511130c5", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.955316Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 586, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.63349995855242, "ttft_ms": 11.85654103755951, "decode_ms": 11.883166967891157}, "total_wall_ms": 51111.41916702036, "ttft_ms": 11.85654103755951, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da4946f419698264580b92a1", "attempt_id": "7f552d794ce9", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:01.220838Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 227.0756249781698, "ttft_ms": 11.885665939189494, "decode_ms": 59.61816699709743}, "total_wall_ms": 51159.6483750036, "ttft_ms": 11.885665939189494, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 6297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80ae66646370c00342102a8d", "attempt_id": "d18af4a3b85d", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:01.534430Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.76312504336238, "ttft_ms": 11.779709020629525, "decode_ms": 95.16625001560897}, "total_wall_ms": 51194.89991699811, "ttft_ms": 11.779709020629525, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13024817", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "672c00df3bfd31225e9d03325d167c25800a9007589a430995bacbf8ad8c6f21"} | ||||
| 6298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b9af61640909b3879536487", "attempt_id": "6ada368df423", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:01.883642Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 585, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.4832080109045, "ttft_ms": 11.929625063203275, "decode_ms": 11.864207917824388}, "total_wall_ms": 51111.36079195421, "ttft_ms": 11.929625063203275, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e15e5250ce71ddcc2658ebf3", "attempt_id": "4cfacac919cb", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:02.150036Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.6715409932658, "ttft_ms": 11.828834074549377, "decode_ms": 11.788082891143858}, "total_wall_ms": 51111.34495900478, "ttft_ms": 11.828834074549377, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fa40e97d71123f2aa82a925c", "attempt_id": "cb55cfe2065c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:02.415622Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.70029196888208, "ttft_ms": 12.28158304002136, "decode_ms": 12.00774998869747}, "total_wall_ms": 51112.22091712989, "ttft_ms": 12.28158304002136, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7002b67bf9eb2768afd17adb", "attempt_id": "fe8d1440d3d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:09.542305Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 460, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 185.85645803250372, "ttft_ms": 11.812999960966408, "decode_ms": 11.776375002227724}, "total_wall_ms": 7068.241458036937, "ttft_ms": 11.812999960966408, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e66adc333f2567da560f1834", "attempt_id": "c06f66d4b144", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:09.768114Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.04087503626943, "ttft_ms": 11.82437501847744, "decode_ms": 11.819040984846652}, "total_wall_ms": 7068.433833075687, "ttft_ms": 11.82437501847744, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "056fe6d894d6b00f9a6e892f", "attempt_id": "1946bf0fb03a", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:09.993313Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.19808298535645, "ttft_ms": 11.798167019151151, "decode_ms": 12.033750070258975}, "total_wall_ms": 7068.761625094339, "ttft_ms": 11.798167019151151, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3db0368256e4ba413236b871", "attempt_id": "15451b002a81", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:10.218798Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 463, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.48212496191263, "ttft_ms": 11.84791699051857, "decode_ms": 11.852917028591037}, "total_wall_ms": 7068.891209084541, "ttft_ms": 11.84791699051857, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59aba285ef0deddc647f3aff", "attempt_id": "42307132b7d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:10.444118Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.20070908218622, "ttft_ms": 11.832916992716491, "decode_ms": 11.83708303142339}, "total_wall_ms": 7068.597042001784, "ttft_ms": 11.832916992716491, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "75f6d2adb964af62f2497c9f", "attempt_id": "daf9373e657b", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:10.669199Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.63504195865244, "ttft_ms": 11.767458054237068, "decode_ms": 117.8340419428423}, "total_wall_ms": 7174.971708096564, "ttft_ms": 11.767458054237068, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MH-96F-2099", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "95c230d14a055d30e0e1d4355caf07808e1c968b1feab9e0607d8bd37b1b43dc"} | ||||
| 6307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3ff94bbdd1ac08e151c22d66", "attempt_id": "219a3b766dfe", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.000924Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 461, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.40212493482977, "ttft_ms": 11.827416019514203, "decode_ms": 11.863624909892678}, "total_wall_ms": 7068.831958109513, "ttft_ms": 11.827416019514203, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "018ba3cc8c9a8cee768e2a80", "attempt_id": "b32d7dec6bc5", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.226520Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 462, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.41974998172373, "ttft_ms": 11.842958047054708, "decode_ms": 11.901790974661708}, "total_wall_ms": 7068.881749990396, "ttft_ms": 11.842958047054708, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "277d6954f787cd5d446f40a6", "attempt_id": "c6f0c2be24bd", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.452007Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.70491699595004, "ttft_ms": 11.804500012658536, "decode_ms": 11.74224994610995}, "total_wall_ms": 7068.991417065263, "ttft_ms": 11.804500012658536, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b7f796434eadb85d1e52c8d", "attempt_id": "4d0a28b5c62d", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.677314Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 185.86433306336403, "ttft_ms": 11.796500068157911, "decode_ms": 82.50654197763652}, "total_wall_ms": 7138.8948750682175, "ttft_ms": 11.796500068157911, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | ||||
| 6311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f2453af5a0ddc4ce71907a99", "attempt_id": "6955e20a5988", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.972728Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.30929209757596, "ttft_ms": 11.884625069797039, "decode_ms": 58.9661659905687}, "total_wall_ms": 7115.869125118479, "ttft_ms": 11.884625069797039, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 6312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f836d7809ff3f93d6c0488a1", "attempt_id": "d2acd35d4fdb", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.244916Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.15483306348324, "ttft_ms": 11.910791974514723, "decode_ms": 82.62462494894862}, "total_wall_ms": 7139.431458082981, "ttft_ms": 11.910791974514723, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9484825", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "667b970507c4c6c7fb572757eb3b5eb04186ddb67a6ef680266b7a0924737993"} | ||||
| 6313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7b5d98d0561e060d6ec4e5f7", "attempt_id": "30aedc46933a", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.541145Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 185.08358299732208, "ttft_ms": 11.85133308172226, "decode_ms": 47.42800001986325}, "total_wall_ms": 7103.088417090476, "ttft_ms": 11.85133308172226, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 6314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f88746fbc36c8068ed7d1ffa", "attempt_id": "48a2686128e3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.800718Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.2459999974817, "ttft_ms": 11.850791983306408, "decode_ms": 11.878332938067615}, "total_wall_ms": 7068.681875127368, "ttft_ms": 11.850791983306408, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b5323b1dbad8832a4b42b95b", "attempt_id": "4d364c2e7123", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:13.025886Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.4105419954285, "ttft_ms": 11.826083064079285, "decode_ms": 11.851917020976543}, "total_wall_ms": 7068.8043751288205, "ttft_ms": 11.826083064079285, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e6cbc70328e25c8357cf35b", "attempt_id": "256aa5c2e015", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.228976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.03099999018013, "ttft_ms": 11.82962500024587, "decode_ms": 11.953708017244935}, "total_wall_ms": 12045.24783405941, "ttft_ms": 11.82962500024587, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7d2c180a1c7770a34353ebea", "attempt_id": "1b45fcde11d4", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.455315Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 185.98220800049603, "ttft_ms": 11.92508393432945, "decode_ms": 11.82125008199364}, "total_wall_ms": 12045.16641702503, "ttft_ms": 11.92508393432945, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4065a27e12390281dc1a284d", "attempt_id": "8d1669b73dd2", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.680748Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.37154099997133, "ttft_ms": 11.898875003680587, "decode_ms": 11.90529193263501}, "total_wall_ms": 12045.558709069155, "ttft_ms": 11.898875003680587, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c1aaf0deef0986db8d193e60", "attempt_id": "3cd5be4201c1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.906734Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 472, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.2717499025166, "ttft_ms": 11.856916011311114, "decode_ms": 11.921083088964224}, "total_wall_ms": 12045.455584069714, "ttft_ms": 11.856916011311114, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "252e4c859c4a0d299f7534e9", "attempt_id": "6deedad5e522", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.131823Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 479, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.42104207538068, "ttft_ms": 11.926540988497436, "decode_ms": 11.951540946029127}, "total_wall_ms": 12045.738041982986, "ttft_ms": 11.926540988497436, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a21420be37a7f74a720ff260", "attempt_id": "f5dca43f25c8", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.357510Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 480, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.9509998941794, "ttft_ms": 11.850583949126303, "decode_ms": 11.91483298316598}, "total_wall_ms": 12046.148416935466, "ttft_ms": 11.850583949126303, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "94c80fa0c3585f8f9a6a4371", "attempt_id": "06c04ad86cff", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.583359Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 185.8234580140561, "ttft_ms": 11.889416025951505, "decode_ms": 11.819042032584548}, "total_wall_ms": 12044.914458063431, "ttft_ms": 11.889416025951505, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "13920be4e8b3077047f4bcb1", "attempt_id": "ca2e4b7fb25e", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.808278Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 185.40650000795722, "ttft_ms": 11.837625061161816, "decode_ms": 12.097875005565584}, "total_wall_ms": 12044.712999952026, "ttft_ms": 11.837625061161816, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f1e1bde8d469b9511959f7dd", "attempt_id": "3b5ca0e31235", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.032809Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 487, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 187.7643340267241, "ttft_ms": 12.007332989014685, "decode_ms": 11.868707952089608}, "total_wall_ms": 12047.183291986585, "ttft_ms": 12.007332989014685, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "626fc8db67d1025bfd518da4", "attempt_id": "185429d9d04f", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.259865Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.68425001669675, "ttft_ms": 12.029709061607718, "decode_ms": 11.898832977749407}, "total_wall_ms": 12046.112125040963, "ttft_ms": 12.029709061607718, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fd4d061eb9a4a8b88d58adca", "attempt_id": "4381706f570f", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.487599Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 486, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 188.31787491217256, "ttft_ms": 11.744957999326289, "decode_ms": 59.13312500342727}, "total_wall_ms": 12094.612958026119, "ttft_ms": 11.744957999326289, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 6327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bcbac3d81b7e97b6b137539c", "attempt_id": "aba4e720a3a9", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.762724Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 184.85312501434237, "ttft_ms": 11.861666920594871, "decode_ms": 71.2572910124436}, "total_wall_ms": 12103.36525097955, "ttft_ms": 11.861666920594871, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "948485", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "244f716d260fa5f07cbedd5d728983a25a4991af5624be73b358ad829974e9c4"} | ||||
| 6328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f3de17234aeea84dd5b95577", "attempt_id": "c15b8c38d8ec", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.046208Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.66945898439735, "ttft_ms": 11.865791049785912, "decode_ms": 47.31558298226446}, "total_wall_ms": 12081.220626016147, "ttft_ms": 11.865791049785912, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 6329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a81ec4ec9bd3a601e58289fe", "attempt_id": "40dbfa1c2926", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.307238Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 183.93512489274144, "ttft_ms": 11.840457911603153, "decode_ms": 11.890291003510356}, "total_wall_ms": 12043.01712603774, "ttft_ms": 11.840457911603153, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b069866f2a9d4a0469f8926e", "attempt_id": "d95444748c58", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.529885Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 484, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 184.3267499934882, "ttft_ms": 12.121375068090856, "decode_ms": 11.842624982818961}, "total_wall_ms": 12043.780250940472, "ttft_ms": 12.121375068090856, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dfa2aa0a6797ae01ac3bb479", "attempt_id": "2e5c39521ba7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:31.702812Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 185.75866695027798, "ttft_ms": 11.88416697550565, "decode_ms": 11.851958930492401}, "total_wall_ms": 21991.85891705565, "ttft_ms": 11.88416697550565, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "15a75188a5ffb34386213b74", "attempt_id": "73a93a1758d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:31.928435Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 185.9312909655273, "ttft_ms": 11.89075002912432, "decode_ms": 11.830749921500683}, "total_wall_ms": 21992.001833976246, "ttft_ms": 11.89075002912432, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eba8144f5bd7dde0d3a2d64c", "attempt_id": "a941fdee95e0", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.153994Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.0080419573933, "ttft_ms": 11.859874939545989, "decode_ms": 11.83879200834781}, "total_wall_ms": 21992.018583929166, "ttft_ms": 11.859874939545989, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f724d68fa8bcbe7d6e1577d2", "attempt_id": "4f84aeec5f94", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.378976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 472, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 185.7952909776941, "ttft_ms": 11.80870900861919, "decode_ms": 11.859916034154594}, "total_wall_ms": 21991.88129301183, "ttft_ms": 11.80870900861919, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36a85823539f6a10202e88a7", "attempt_id": "127c2829dc22", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.603630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 479, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.8701659841463, "ttft_ms": 12.091000098735094, "decode_ms": 12.0086669921875}, "total_wall_ms": 21993.4917089995, "ttft_ms": 12.091000098735094, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "37830f8f492bf43790a4f5cd", "attempt_id": "b5793ea260aa", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.830677Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 480, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.83437502477318, "ttft_ms": 11.896374984644353, "decode_ms": 118.63562499638647}, "total_wall_ms": 22099.718958954327, "ttft_ms": 11.896374984644353, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MH-96F-2099", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "95c230d14a055d30e0e1d4355caf07808e1c968b1feab9e0607d8bd37b1b43dc"} | ||||
| 6337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b4a1c5c1a5cb96858488e5c", "attempt_id": "083ea0124ec7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.163667Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.04454200249165, "ttft_ms": 12.004374992102385, "decode_ms": 12.01070798560977}, "total_wall_ms": 21992.376458947547, "ttft_ms": 12.004374992102385, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "382141b8893e0a3ed2316441", "attempt_id": "050db41f693c", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.388935Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.2477499525994, "ttft_ms": 11.954624904319644, "decode_ms": 11.891416972503066}, "total_wall_ms": 21992.477542953566, "ttft_ms": 11.954624904319644, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "29696173109d11f819ab2338", "attempt_id": "b43101214d10", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.614253Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 487, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 188.15254094079137, "ttft_ms": 11.985791963525116, "decode_ms": 11.900500045157969}, "total_wall_ms": 21994.395583984442, "ttft_ms": 11.985791963525116, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5ad9569a760a8b4a55e2f797", "attempt_id": "66a285a6515c", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.842033Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.2962500890717, "ttft_ms": 11.930083041079342, "decode_ms": 82.44408294558525}, "total_wall_ms": 22063.01591708325, "ttft_ms": 11.930083041079342, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | ||||
| 6341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "028a9e0044c5d46d286f6fed", "attempt_id": "60c5a1ca23d5", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.138017Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 486, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 187.87783302832395, "ttft_ms": 12.163541978225112, "decode_ms": 59.53324993606657}, "total_wall_ms": 22042.043125955388, "ttft_ms": 12.163541978225112, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 6342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "527e2d10941436d9843e61a1", "attempt_id": "c592b95a8f96", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.413111Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 183.64629102870822, "ttft_ms": 12.180499965324998, "decode_ms": 71.41625008080155}, "total_wall_ms": 22049.708334030584, "ttft_ms": 12.180499965324998, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "948485", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "244f716d260fa5f07cbedd5d728983a25a4991af5624be73b358ad829974e9c4"} | ||||
| 6343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aeae98ccabe2505393002aa1", "attempt_id": "766c03efe5d0", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.696891Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.47487496491522, "ttft_ms": 11.89762493595481, "decode_ms": 47.2524999640882}, "total_wall_ms": 22027.974458993413, "ttft_ms": 11.89762493595481, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 6344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c41f0753cb706d74e42b6b3", "attempt_id": "c4ac4a286d9f", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.958329Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 184.58412494510412, "ttft_ms": 11.8815409950912, "decode_ms": 11.83712505735457}, "total_wall_ms": 21990.61270907987, "ttft_ms": 11.8815409950912, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8d38122e717d899535c9eb40", "attempt_id": "38249278f441", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:35.181575Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 484, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 184.33633400127292, "ttft_ms": 12.082625064067543, "decode_ms": 11.769582983106375}, "total_wall_ms": 21990.528916940093, "ttft_ms": 12.082625064067543, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a5e8c30bfca2b101baa1e68", "attempt_id": "b78523874eab", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:28.022760Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 340.0229170219973, "ttft_ms": 45.39320897310972, "decode_ms": 45.83379102405161}, "total_wall_ms": 74826.11566700507, "ttft_ms": 45.39320897310972, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a683658fa9392dd17ce6440", "attempt_id": "eb547cf2883a", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:28.472013Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 352.55520802456886, "ttft_ms": 40.868874988518655, "decode_ms": 49.819333013147116}, "total_wall_ms": 74838.15391699318, "ttft_ms": 40.868874988518655, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8fb2dac235b6f6ce7584c34b", "attempt_id": "d2685afb6944", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:28.932361Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 349.36150000430644, "ttft_ms": 45.4847919754684, "decode_ms": 45.87041598279029}, "total_wall_ms": 74835.56275104638, "ttft_ms": 45.4847919754684, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a9f593f2ff39fcf69b942f42", "attempt_id": "6d7e7ec41a6c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:29.390259Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 472, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 347.4786669248715, "ttft_ms": 43.20362501312047, "decode_ms": 43.96199993789196}, "total_wall_ms": 74829.48395900894, "ttft_ms": 43.20362501312047, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad0f49cc3de245521249fc25", "attempt_id": "21cfa4f1a7f0", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:29.841743Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 479, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 352.6987920049578, "ttft_ms": 43.187833041884005, "decode_ms": 42.309709009714425}, "total_wall_ms": 74833.044292056, "ttft_ms": 43.187833041884005, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3502e86bf97404a55715cc00", "attempt_id": "e0d344a6d861", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:30.297083Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 480, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 345.83670797292143, "ttft_ms": 42.64020803384483, "decode_ms": 44.390999944880605}, "total_wall_ms": 74827.73033308331, "ttft_ms": 42.64020803384483, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ac43d333871d75b68cd3c0e", "attempt_id": "9fa8def0c378", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:30.747369Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 352.1522500086576, "ttft_ms": 42.748916894197464, "decode_ms": 43.836083030328155}, "total_wall_ms": 74833.56412500143, "ttft_ms": 42.748916894197464, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0bd0d9236e7e6858679ebca3", "attempt_id": "df60b3a28f0c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:31.203193Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 348.0954170227051, "ttft_ms": 43.39912498835474, "decode_ms": 45.071667060256004}, "total_wall_ms": 74831.42375107855, "ttft_ms": 43.39912498835474, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f90358cc02c8683295d680bb", "attempt_id": "78ca28800c77", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:31.656557Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 487, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 343.14599994104356, "ttft_ms": 43.34687499795109, "decode_ms": 44.94879103731364}, "total_wall_ms": 74826.35062502231, "ttft_ms": 43.34687499795109, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc9ce330ccf4853dfb3dcb38", "attempt_id": "f825c6f6578c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:32.105447Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 345.6582920625806, "ttft_ms": 47.286625020205975, "decode_ms": 47.979500028304756}, "total_wall_ms": 74835.76629206073, "ttft_ms": 47.286625020205975, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a41acb50667e7f864294bac0", "attempt_id": "c11804a977a9", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:32.563433Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 486, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 349.50512496288866, "ttft_ms": 43.788625043816864, "decode_ms": 230.5075420299545}, "total_wall_ms": 75018.74208403751, "ttft_ms": 43.788625043816864, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 6357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f41941a5d8bcebe43141d429", "attempt_id": "4628dc9ce16e", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:33.204580Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 322.29170901700854, "ttft_ms": 41.97966691572219, "decode_ms": 336.1370420316234}, "total_wall_ms": 75095.3966670204, "ttft_ms": 41.97966691572219, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9484825", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "667b970507c4c6c7fb572757eb3b5eb04186ddb67a6ef680266b7a0924737993"} | ||||
| 6358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7e420a79e238512cb1897a09", "attempt_id": "4dffb167c771", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:33.922899Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 334.5014579826966, "ttft_ms": 43.67445793468505, "decode_ms": 177.05166607629508}, "total_wall_ms": 74950.17541700508, "ttft_ms": 43.67445793468505, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 6359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "14202cc2f32a4176dd106b01", "attempt_id": "b035e5911950", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:34.496099Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 287.6303750090301, "ttft_ms": 50.758292083628476, "decode_ms": 45.91450002044439}, "total_wall_ms": 74779.32237612549, "ttft_ms": 50.758292083628476, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fd33d63090bdafcef3f49ccf", "attempt_id": "eed2993c9598", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:34.898102Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 484, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 312.707083998248, "ttft_ms": 66.90520804841071, "decode_ms": 30.21133306901902}, "total_wall_ms": 74804.78116706945, "ttft_ms": 66.90520804841071, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3f32aff76e950cc1f431ac0b", "attempt_id": "18e8a15f2269", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:57.689777Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.15991700533777, "ttft_ms": 11.977292015217245, "decode_ms": 12.12245796341449}, "total_wall_ms": 22613.57029201463, "ttft_ms": 11.977292015217245, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ccce6a133688b4134eca730", "attempt_id": "69d1ebce5c5d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:57.958203Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.10354207083583, "ttft_ms": 11.963792028836906, "decode_ms": 130.18362503498793}, "total_wall_ms": 22731.602748972364, "ttft_ms": 11.963792028836906, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 6363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "69fd52a6e9e971b5b0f1a5be", "attempt_id": "c3cd2d356187", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:58.344277Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.86120797879994, "ttft_ms": 12.056584004312754, "decode_ms": 83.35712493862957}, "total_wall_ms": 22684.603373985738, "ttft_ms": 12.056584004312754, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 6364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "086a7f165c3fbc3ff0a9a94d", "attempt_id": "8fe5df06bc82", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:58.683917Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.997458958067, "ttft_ms": 11.92891609389335, "decode_ms": 47.57245793007314}, "total_wall_ms": 22648.729874985293, "ttft_ms": 11.92891609389335, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 6365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3b07f98b72002e5a2beb5675", "attempt_id": "480b6b5c4b68", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:58.987077Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.1020410116762, "ttft_ms": 11.852875002659857, "decode_ms": 11.78449997678399}, "total_wall_ms": 22612.94329096563, "ttft_ms": 11.852875002659857, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a70ed564ccfaa4f69e25a5db", "attempt_id": "180361820b0d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:59.253998Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.24337503314018, "ttft_ms": 12.091082986444235, "decode_ms": 130.82462491001934}, "total_wall_ms": 22732.50016605016, "ttft_ms": 12.091082986444235, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 6367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55ab9256a03c14bb7dd4931b", "attempt_id": "ef477ebc6624", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:59.640788Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.3879170641303, "ttft_ms": 12.00712495483458, "decode_ms": 11.904167011380196}, "total_wall_ms": 22612.498832982965, "ttft_ms": 12.00712495483458, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7abf703b61fcd40e55e50017", "attempt_id": "8c998977055d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:59.907437Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.28329205326736, "ttft_ms": 12.032249942421913, "decode_ms": 11.911874986253679}, "total_wall_ms": 22612.483248929493, "ttft_ms": 12.032249942421913, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 6369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d65af73e32722271da5a697f", "attempt_id": "69e2265cd084", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.173848Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 228.54887507855892, "ttft_ms": 12.094540987163782, "decode_ms": 11.97579107247293}, "total_wall_ms": 22614.94124995079, "ttft_ms": 12.094540987163782, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b77b378869a751190db2006", "attempt_id": "dc6e82d8f82f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.442933Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.77829093299806, "ttft_ms": 11.983916047029197, "decode_ms": 11.876125005073845}, "total_wall_ms": 22612.849042052403, "ttft_ms": 11.983916047029197, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e648daf57fc4b7499c862983", "attempt_id": "8933bb3596ed", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.709933Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 609, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.77929198835045, "ttft_ms": 11.996500077657402, "decode_ms": 59.55533299129456}, "total_wall_ms": 22660.552707966417, "ttft_ms": 11.996500077657402, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 6372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36038c95f552b868a77e602c", "attempt_id": "ed6f2fe9ce1e", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.024375Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.84737492818385, "ttft_ms": 11.92341698333621, "decode_ms": 83.45675002783537}, "total_wall_ms": 22684.485999983735, "ttft_ms": 11.92341698333621, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1302481", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1c130ebf03e5051f031da47a49e8c91caae34e3c2144f451ec045a8e1c85549d"} | ||||
| 6373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "492c0d6f11ac682eb4512d80", "attempt_id": "1fafdc280733", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.362678Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.03187505248934, "ttft_ms": 11.922708945348859, "decode_ms": 11.946249986067414}, "total_wall_ms": 22613.093541003764, "ttft_ms": 11.922708945348859, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2df4dd884149fe98087de143", "attempt_id": "2afa5408fb88", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.630041Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.51516697462648, "ttft_ms": 12.134875054471195, "decode_ms": 11.938791954889894}, "total_wall_ms": 22613.76391700469, "ttft_ms": 12.134875054471195, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c686aa3b751a76688e4f0425", "attempt_id": "2f78f3dc67fc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.897387Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.29337494820356, "ttft_ms": 12.00641703326255, "decode_ms": 11.979499948211014}, "total_wall_ms": 22613.481333013624, "ttft_ms": 12.00641703326255, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f862c2ccc6a03ef548071aab", "attempt_id": "045bce2d6652", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:07.294655Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 523, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.22116695530713, "ttft_ms": 11.660957941785455, "decode_ms": 11.498666950501502}, "total_wall_ms": 27724.15650007315, "ttft_ms": 11.660957941785455, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "db12f48a9bbcdbd11e580978", "attempt_id": "4d033e5560f0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:07.544880Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 529, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 209.99633392784745, "ttft_ms": 11.670165928080678, "decode_ms": 115.16645806841552}, "total_wall_ms": 27827.570000081323, "ttft_ms": 11.670165928080678, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "d34fb8d4553d115f1c915ac9be75f68ef887916efddf5ed339f7cf4236ce8fa8"} | ||||
| 6378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "20467eed2b5a943e1a5f0fa7", "attempt_id": "4d1c73b5afe8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:07.898088Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 529, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.57508408557624, "ttft_ms": 11.598790995776653, "decode_ms": 45.95241602510214}, "total_wall_ms": 27758.832333027385, "ttft_ms": 11.598790995776653, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 6379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "763d60481be4b5a97d68cdf6", "attempt_id": "9929b23e05b4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.182280Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 526, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.09791700635105, "ttft_ms": 11.771790916100144, "decode_ms": 57.52425000537187}, "total_wall_ms": 27770.269833039492, "ttft_ms": 11.771790916100144, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "4b9af6bc1085ca0df8d10d93274bfa44fbaf913b3380b2525ac5097c55375881"} | ||||
| 6380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03a50238aa5cbe37b7e41a6b", "attempt_id": "0db3937a6c23", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.477645Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 533, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.60975000727922, "ttft_ms": 11.655749985948205, "decode_ms": 11.569624999538064}, "total_wall_ms": 27724.703874089755, "ttft_ms": 11.655749985948205, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "43c03f1b00667b18510f48ab", "attempt_id": "eb438b0eca2a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.728978Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 532, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.614874958992, "ttft_ms": 11.602125014178455, "decode_ms": 92.22799993585795}, "total_wall_ms": 27805.317124002613, "ttft_ms": 11.602125014178455, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 6382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c675939ad6211efbb6373c30", "attempt_id": "92017bd50999", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.060414Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 524, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 209.64662497863173, "ttft_ms": 11.932790977880359, "decode_ms": 23.21420900989324}, "total_wall_ms": 27735.703124082647, "ttft_ms": 11.932790977880359, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83fbc27fe5935e587845e2bb", "attempt_id": "72dfab763b07", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.321282Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 525, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.05875000264496, "ttft_ms": 11.809790972620249, "decode_ms": 23.053209064528346}, "total_wall_ms": 27735.625999979675, "ttft_ms": 11.809790972620249, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 6384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad46b8a8e7e6aac75a20b736", "attempt_id": "67cbc96658cc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.583398Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 541, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.89633298106492, "ttft_ms": 11.642707977443933, "decode_ms": 11.571875074878335}, "total_wall_ms": 27724.89658300765, "ttft_ms": 11.642707977443933, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c05955bfb683065921a22812", "attempt_id": "1e21de775118", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.833444Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 532, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.49687499180436, "ttft_ms": 11.573707917705178, "decode_ms": 11.591500020585954}, "total_wall_ms": 27724.35154102277, "ttft_ms": 11.573707917705178, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9b4347ff7944f073058090bf", "attempt_id": "be92416beb33", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:10.083222Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 540, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.98874998278916, "ttft_ms": 11.540542007423937, "decode_ms": 11.573166935704648}, "total_wall_ms": 27724.788957973942, "ttft_ms": 11.540542007423937, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c3923e64928b533ab815197f", "attempt_id": "974a25d8a3b2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:10.332740Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 536, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.7438329840079, "ttft_ms": 11.577583965845406, "decode_ms": 219.00204208213836}, "total_wall_ms": 27932.060915976763, "ttft_ms": 11.577583965845406, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,862,425 + 5,646,720 = 10,509,145", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "038d9ed23c4639e6ae998b25ae021dada1e0ab0526113d0a0e4d8884ea4b4e6f"} | ||||
| 6388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b8340747be15e7671266d69d", "attempt_id": "74b2ac82de5f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:10.789438Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 531, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.57391597423702, "ttft_ms": 11.641624965704978, "decode_ms": 11.491750017739832}, "total_wall_ms": 27724.412208073772, "ttft_ms": 11.641624965704978, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "54a7b3e6aea0779e89e63106", "attempt_id": "6291ce6a3a2a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:11.038833Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 535, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.2422920288518, "ttft_ms": 11.586208012886345, "decode_ms": 11.50383404456079}, "total_wall_ms": 27724.0187501302, "ttft_ms": 11.586208012886345, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50a80ab68c959295f0b3f3d5", "attempt_id": "15b0346e5d8c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:11.287613Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 538, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.84425004664809, "ttft_ms": 11.568416957743466, "decode_ms": 11.542583000846207}, "total_wall_ms": 27724.645416019484, "ttft_ms": 11.568416957743466, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8f8e838994a5174ead46b7d5", "attempt_id": "8cf5d1f0b1e4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:21.918304Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 487, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.54650002345443, "ttft_ms": 11.57233293633908, "decode_ms": 11.76929206121713}, "total_wall_ms": 38100.84308194928, "ttft_ms": 11.57233293633908, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2db0d38245b2405e048a54e0", "attempt_id": "70b698c53a4f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:22.166273Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 493, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 209.6134580206126, "ttft_ms": 11.551541974768043, "decode_ms": 115.2444159379229}, "total_wall_ms": 38206.339915981516, "ttft_ms": 11.551541974768043, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "d34fb8d4553d115f1c915ac9be75f68ef887916efddf5ed339f7cf4236ce8fa8"} | ||||
| 6393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c274063c0b31713f29296ab0", "attempt_id": "ff432b7730f3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:22.518638Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 493, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.88049995806068, "ttft_ms": 11.547166970558465, "decode_ms": 45.98920908756554}, "total_wall_ms": 38134.30274894927, "ttft_ms": 11.547166970558465, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 6394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "08abe6ac6fa2a1af4a65fef3", "attempt_id": "5d5f05aef9e0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:22.798662Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 490, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 205.76804096344858, "ttft_ms": 11.562332976609468, "decode_ms": 45.92741699889302}, "total_wall_ms": 38133.16487404518, "ttft_ms": 11.562332976609468, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 6395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "79e4060b1f6f6b4884b63681", "attempt_id": "172508a55104", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.077990Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 497, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 208.45854096114635, "ttft_ms": 11.590208043344319, "decode_ms": 11.560541926883161}, "total_wall_ms": 38101.5318329446, "ttft_ms": 11.590208043344319, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a562deb1d153141db63bc3ae", "attempt_id": "c81fbe85b986", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.325117Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 496, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.76049990672618, "ttft_ms": 11.609584093093872, "decode_ms": 91.86570800375193}, "total_wall_ms": 38181.12691491842, "ttft_ms": 11.609584093093872, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 6397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3fbff6745fe8870007f76375", "attempt_id": "a444b81acc61", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.652075Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 488, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 205.86283307056874, "ttft_ms": 11.583667015656829, "decode_ms": 23.060834035277367}, "total_wall_ms": 38110.413582995534, "ttft_ms": 11.583667015656829, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e3cec7c9b0ec4868d6642da", "attempt_id": "2f59ef09a633", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.908264Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 489, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 204.29266605060548, "ttft_ms": 11.598250013776124, "decode_ms": 23.074583965353668}, "total_wall_ms": 38108.83570695296, "ttft_ms": 11.598250013776124, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 6399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3d866a4a0d91dc939570e711", "attempt_id": "186e9400ec55", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.162872Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 505, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.75370893534273, "ttft_ms": 11.625792016275227, "decode_ms": 11.582374921999872}, "total_wall_ms": 38100.87904101238, "ttft_ms": 11.625792016275227, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc7b085d691e3ff4e3a0e760", "attempt_id": "757bc48ff199", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.409225Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 496, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 203.9944170974195, "ttft_ms": 11.524083907715976, "decode_ms": 11.50795805733651}, "total_wall_ms": 38096.91137401387, "ttft_ms": 11.524083907715976, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b2c19d6fc08f28efbe8c682", "attempt_id": "f4f7ab28d7a2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.652131Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 504, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.81166602298617, "ttft_ms": 11.575083015486598, "decode_ms": 11.601999984122813}, "total_wall_ms": 38099.86699896399, "ttft_ms": 11.575083015486598, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3a1f23850d4f95f7b6b6870c", "attempt_id": "99402b636d75", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.897630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 500, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.85012498870492, "ttft_ms": 11.604624916799366, "decode_ms": 219.0847919555381}, "total_wall_ms": 38307.52749904059, "ttft_ms": 11.604624916799366, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,862,425 + 5,646,720 = 10,509,145", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "038d9ed23c4639e6ae998b25ae021dada1e0ab0526113d0a0e4d8884ea4b4e6f"} | ||||
| 6403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "87302980abc81826c43804e4", "attempt_id": "e37a2124be1c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:25.350792Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 495, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.85816700663418, "ttft_ms": 11.542499996721745, "decode_ms": 11.541875079274178}, "total_wall_ms": 38100.84054002073, "ttft_ms": 11.542499996721745, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9d9fda703c1bf5aac43ed159", "attempt_id": "dda852f30875", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:25.597921Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 499, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.54475002083927, "ttft_ms": 11.62362506147474, "decode_ms": 11.549124959856272}, "total_wall_ms": 38099.6261240216, "ttft_ms": 11.62362506147474, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2098f6b968e839a34bf81661", "attempt_id": "5f675f70215c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:25.843454Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 502, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.72512489929795, "ttft_ms": 11.560374987311661, "decode_ms": 11.518125073052943}, "total_wall_ms": 38100.68291600328, "ttft_ms": 11.560374987311661, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "47b0c435f5590667052b70cc", "attempt_id": "9f605633dd38", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:47.377868Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 496, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 205.95662505365908, "ttft_ms": 11.59316604025662, "decode_ms": 11.459583067335188}, "total_wall_ms": 59381.6127498867, "ttft_ms": 11.59316604025662, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "99a3d543aa37f01f328ea23a", "attempt_id": "9ab8015c9dc0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:47.623528Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 502, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.6960830707103, "ttft_ms": 11.563332984223962, "decode_ms": 114.8346250411123}, "total_wall_ms": 59485.684790997766, "ttft_ms": 11.563332984223962, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "d34fb8d4553d115f1c915ac9be75f68ef887916efddf5ed339f7cf4236ce8fa8"} | ||||
| 6408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89a65bba6e1b336011f8aec9", "attempt_id": "20a4b51c9156", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:47.972924Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 502, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.66645804885775, "ttft_ms": 11.547207948751748, "decode_ms": 46.02350003551692}, "total_wall_ms": 59416.78358300123, "ttft_ms": 11.547207948751748, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 6409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b00612f22399e784b78945b2", "attempt_id": "01cbb4d53e4c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:48.253248Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 499, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 210.11308289598674, "ttft_ms": 11.517458013258874, "decode_ms": 45.92083301395178}, "total_wall_ms": 59420.10579095222, "ttft_ms": 11.517458013258874, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 6410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b66a30ba67b1da9ef5ac9a7", "attempt_id": "b74ae4e23191", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:48.536596Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 506, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 208.13258294947445, "ttft_ms": 11.538416962139308, "decode_ms": 11.483917012810707}, "total_wall_ms": 59383.72379099019, "ttft_ms": 11.538416962139308, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d81a69863438829b555f8f8f", "attempt_id": "f13f602f2686", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:48.783277Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 505, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.34704106487334, "ttft_ms": 11.641249991953373, "decode_ms": 92.6754999672994}, "total_wall_ms": 59463.234957889654, "ttft_ms": 11.641249991953373, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 6412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bce7b4e9487dea641eff9f6b", "attempt_id": "70b01a767e43", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.109760Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 497, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 207.62108301278204, "ttft_ms": 11.487792013213038, "decode_ms": 22.975333034992218}, "total_wall_ms": 59394.65216593817, "ttft_ms": 11.487792013213038, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "11f6ab043bd0d6445d4a22fc", "attempt_id": "e1d62530d976", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.367570Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 498, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.44120790529996, "ttft_ms": 11.569041991606355, "decode_ms": 23.052542004734278}, "total_wall_ms": 59393.60666600987, "ttft_ms": 11.569041991606355, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 6414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e69b55d29e1ef6ce3f95370", "attempt_id": "91ed5581f304", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.624050Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 514, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 209.82333295978606, "ttft_ms": 11.583083076402545, "decode_ms": 11.585792060941458}, "total_wall_ms": 59385.55579201784, "ttft_ms": 11.583083076402545, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "db2e2ca503c3437617be4518", "attempt_id": "2e08cbf2b593", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.872062Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 505, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 207.5721659930423, "ttft_ms": 11.556250043213367, "decode_ms": 11.70158397872001}, "total_wall_ms": 59383.36149987299, "ttft_ms": 11.556250043213367, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "554d52fa0c367eb1ec9d15aa", "attempt_id": "5324c66f387a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.118455Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 513, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 201.75858295988292, "ttft_ms": 12.069458025507629, "decode_ms": 11.520624975673854}, "total_wall_ms": 59377.917541889474, "ttft_ms": 12.069458025507629, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "316c03a73ff4f029fa238073", "attempt_id": "ada79664ec3a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.359256Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 509, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 209.5855000661686, "ttft_ms": 11.568957939743996, "decode_ms": 57.92950000613928}, "total_wall_ms": 59431.65408296045, "ttft_ms": 11.568957939743996, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,462,111", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "1e8c5e2011479311a255cce5a1f78bfee345f6bb870c300bc4a818f9676ae0f7"} | ||||
| 6418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "daec267862fd7be55147e162", "attempt_id": "4eb8785ee3ae", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.653864Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 504, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 207.30849995743483, "ttft_ms": 11.553292046301067, "decode_ms": 11.53462496586144}, "total_wall_ms": 59382.938416907564, "ttft_ms": 11.553292046301067, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16ee8ff78db3d832aa9646c6", "attempt_id": "f12a737cf5bc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.899998Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 508, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 208.131332998164, "ttft_ms": 11.484291986562312, "decode_ms": 11.48550002835691}, "total_wall_ms": 59383.632665965706, "ttft_ms": 11.484291986562312, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "403a324c3a443931c24c3464", "attempt_id": "667c30b3b48f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:51.146374Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 511, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 209.0514999581501, "ttft_ms": 11.6252499865368, "decode_ms": 11.530208983458579}, "total_wall_ms": 59384.7572079394, "ttft_ms": 11.6252499865368, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d94bd2b391c9476d7942e1a9", "attempt_id": "d24b59948acb", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.292749Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 460, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.3049589553848, "ttft_ms": 11.899915989488363, "decode_ms": 11.902792030014098}, "total_wall_ms": 7105.795498937368, "ttft_ms": 11.899915989488363, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c627238105d4610f85562eb6", "attempt_id": "a5f5dcd96290", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.519084Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.94200001098216, "ttft_ms": 11.91279198974371, "decode_ms": 11.917916941456497}, "total_wall_ms": 7106.413958012126, "ttft_ms": 11.91279198974371, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad23cd890228829d4da8d7a1", "attempt_id": "68906bce5b5d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.744947Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.74570794589818, "ttft_ms": 11.916583054699004, "decode_ms": 11.870707967318594}, "total_wall_ms": 7106.15970811341, "ttft_ms": 11.916583054699004, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "298ded8dadbaead1a4fe8379", "attempt_id": "e90500f4de7f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.970603Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 463, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.68716698791832, "ttft_ms": 11.910875095054507, "decode_ms": 11.900958023034036}, "total_wall_ms": 7106.149208033457, "ttft_ms": 11.910875095054507, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fdb95e87f6532bec0e8ea726", "attempt_id": "161443b5114e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.196006Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.10466609243304, "ttft_ms": 11.861750041134655, "decode_ms": 11.738874949514866}, "total_wall_ms": 7106.345208012499, "ttft_ms": 11.861750041134655, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4691649577f490c260a5e72b", "attempt_id": "590d592a7558", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.421712Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.07658299151808, "ttft_ms": 11.910666013136506, "decode_ms": 118.41008299961686}, "total_wall_ms": 7213.05958298035, "ttft_ms": 11.910666013136506, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MH-96F-2099", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "95c230d14a055d30e0e1d4355caf07808e1c968b1feab9e0607d8bd37b1b43dc"} | ||||
| 6427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "21efce31b54db81fd2083aa9", "attempt_id": "9d1eaba4b5f2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.755399Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 461, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.44695805758238, "ttft_ms": 11.878374963998795, "decode_ms": 11.877959012053907}, "total_wall_ms": 7105.824374011718, "ttft_ms": 11.878374963998795, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "70651103e2d6240d7d54aa63", "attempt_id": "beaf88b29f38", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.980738Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 462, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.67370797973126, "ttft_ms": 11.92712492775172, "decode_ms": 11.881958926096559}, "total_wall_ms": 7106.162457959726, "ttft_ms": 11.92712492775172, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6bac3956a13836af56a96c9f", "attempt_id": "ec25bf611281", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:00.205976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.0346250468865, "ttft_ms": 11.902834055945277, "decode_ms": 11.930583976209164}, "total_wall_ms": 7106.514499988407, "ttft_ms": 11.902834055945277, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ec08c98c3933b9421a97c0dd", "attempt_id": "3688ec5e64f1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:00.432038Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.93170901294798, "ttft_ms": 11.897167074494064, "decode_ms": 82.97449990641326}, "total_wall_ms": 7177.434250130318, "ttft_ms": 11.897167074494064, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | ||||
| 6431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "99ead5cb42605d885af16045", "attempt_id": "6006dfe167ac", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:00.728630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.8581249145791, "ttft_ms": 12.082583038136363, "decode_ms": 59.241166920401156}, "total_wall_ms": 7154.818832990713, "ttft_ms": 12.082583038136363, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 6432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5e2d348c636307add8dd93fa", "attempt_id": "95599e5221b8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.002997Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.658582999371, "ttft_ms": 11.848250054754317, "decode_ms": 83.23183306492865}, "total_wall_ms": 7178.38500009384, "ttft_ms": 11.848250054754317, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9484825", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "667b970507c4c6c7fb572757eb3b5eb04186ddb67a6ef680266b7a0924737993"} | ||||
| 6433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4cc7f5f99bcd42d25d3b32c8", "attempt_id": "db0b1823d1af", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.300606Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.568124987185, "ttft_ms": 11.901542078703642, "decode_ms": 47.460832982324064}, "total_wall_ms": 7141.546333092265, "ttft_ms": 11.901542078703642, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 6434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bd0dda3d16fc4715cfe7cd86", "attempt_id": "d57050504468", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.561261Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.87141600437462, "ttft_ms": 11.87141693662852, "decode_ms": 11.888000066392124}, "total_wall_ms": 7106.263792025857, "ttft_ms": 11.87141693662852, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6fb0cc24c8692d1e1421e0c", "attempt_id": "2263ec42fefc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.786559Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.947582940571, "ttft_ms": 12.029374949634075, "decode_ms": 11.90191600471735}, "total_wall_ms": 7106.496624997817, "ttft_ms": 12.029374949634075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ee5cdf80b64d488a3b00110", "attempt_id": "0eb57dbca981", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:06.307676Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 452, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 200.07650007028133, "ttft_ms": 11.643542093224823, "decode_ms": 11.542499996721745}, "total_wall_ms": 11414.357333094813, "ttft_ms": 11.643542093224823, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4519603f860f348a0a6c6b2d", "attempt_id": "ebd3a9b74a86", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:06.547993Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.44499994441867, "ttft_ms": 11.635957984253764, "decode_ms": 11.510084033943713}, "total_wall_ms": 11416.62091598846, "ttft_ms": 11.635957984253764, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0210c299a673a58a8657a332", "attempt_id": "f57bb37548a9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:06.790192Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.78220798354596, "ttft_ms": 11.736541986465454, "decode_ms": 11.570625007152557}, "total_wall_ms": 11417.214958113618, "ttft_ms": 11.736541986465454, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c81f41666a0553f5a57da6eb", "attempt_id": "d81a7cc6762e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.032580Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 455, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 201.61716593429446, "ttft_ms": 11.642958037555218, "decode_ms": 11.505665956065059}, "total_wall_ms": 11415.777583024465, "ttft_ms": 11.642958037555218, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ff5dbe3458154d43b364f052", "attempt_id": "b993906eee4b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.273243Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 462, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.95933301188052, "ttft_ms": 11.543333996087313, "decode_ms": 11.669458006508648}, "total_wall_ms": 11418.174999998882, "ttft_ms": 11.543333996087313, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "28281e6eec70eee2481a6751", "attempt_id": "5d4bd0a99718", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.516176Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.4829999320209, "ttft_ms": 11.53916702605784, "decode_ms": 11.539792059920728}, "total_wall_ms": 11417.54320799373, "ttft_ms": 11.53916702605784, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc418b36d9accce7b295a3e3", "attempt_id": "c706385040be", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.758247Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 453, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.41237501613796, "ttft_ms": 11.804334004409611, "decode_ms": 23.27070792671293}, "total_wall_ms": 11428.596249083057, "ttft_ms": 11.804334004409611, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03dab83f7c9088cb70f1f04f", "attempt_id": "8074c2d95dc9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.011637Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 454, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 199.69187502283603, "ttft_ms": 11.559708043932915, "decode_ms": 11.51358406059444}, "total_wall_ms": 11413.757000002079, "ttft_ms": 11.559708043932915, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fbd28c25e407a34fa567bdb9", "attempt_id": "a6f8fc675d36", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.250525Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 470, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 204.81916691642255, "ttft_ms": 11.57983299344778, "decode_ms": 11.55637507326901}, "total_wall_ms": 11418.969124089926, "ttft_ms": 11.57983299344778, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3367c76ca1ea311009197e69", "attempt_id": "4a9a55e26ed9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.494368Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.2025830121711, "ttft_ms": 11.617250042036176, "decode_ms": 11.478040949441493}, "total_wall_ms": 11417.28666704148, "ttft_ms": 11.617250042036176, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d07793136fa65ff0a9ef5424", "attempt_id": "3dd7673edfd8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.736237Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 469, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.61879095435143, "ttft_ms": 11.561291990801692, "decode_ms": 11.525708017870784}, "total_wall_ms": 11417.696125106886, "ttft_ms": 11.561291990801692, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "310b3a162b944435e740c295", "attempt_id": "b2e905b5590e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.978325Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 465, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.004500082694, "ttft_ms": 11.60787499975413, "decode_ms": 57.55241704173386}, "total_wall_ms": 11462.183666066267, "ttft_ms": 11.60787499975413, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,646,720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "2c0bb14ad8ba61e6d23fb3dea5205f2f02c43c95a0cf8e7f93c240ddea626ad4"} | ||||
| 6448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc7d9218e620071898a4957b", "attempt_id": "4131ea95c074", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:09.264754Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 460, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.61016709264368, "ttft_ms": 11.743166018277407, "decode_ms": 11.507582967169583}, "total_wall_ms": 11416.990875033662, "ttft_ms": 11.743166018277407, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e762b48fc37a7271532bdabc", "attempt_id": "01e20a9e4f12", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:09.506764Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 464, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.15854204818606, "ttft_ms": 11.63029100280255, "decode_ms": 11.580833001062274}, "total_wall_ms": 11417.369041126221, "ttft_ms": 11.63029100280255, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d258f30414555b6c349fd536", "attempt_id": "f3e75c686786", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:09.750179Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 467, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 206.60366595257074, "ttft_ms": 11.58149994444102, "decode_ms": 11.544415960088372}, "total_wall_ms": 11420.725042000413, "ttft_ms": 11.58149994444102, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8f51afd6a3544ce47ce942b1", "attempt_id": "b3f44e92663a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.234183Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 452, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 200.9144159965217, "ttft_ms": 11.578792007640004, "decode_ms": 11.575500015169382}, "total_wall_ms": 20651.235541095957, "ttft_ms": 11.578792007640004, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e4298900a03447465092fed8", "attempt_id": "1d53ea775d50", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.475048Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.46641694009304, "ttft_ms": 11.554333032108843, "decode_ms": 11.557165998965502}, "total_wall_ms": 20651.710916077718, "ttft_ms": 11.554333032108843, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c37b86cc101392b4e8285445", "attempt_id": "a99efe5d33dd", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.715598Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.89791696611792, "ttft_ms": 11.592500028200448, "decode_ms": 11.51408301666379}, "total_wall_ms": 20652.13854110334, "ttft_ms": 11.592500028200448, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7c6a520be8ad0b768553c595", "attempt_id": "99eef91f6b57", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.956900Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 455, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.12816607858986, "ttft_ms": 11.556084034964442, "decode_ms": 11.61312498152256}, "total_wall_ms": 20654.435958131216, "ttft_ms": 11.556084034964442, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "efe37abcbe89ef07627af361", "attempt_id": "e072f435244f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.199770Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 462, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 202.47225009370595, "ttft_ms": 11.574000003747642, "decode_ms": 11.491082957945764}, "total_wall_ms": 20652.672000112943, "ttft_ms": 11.574000003747642, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "107b07f4145dc353204941b7", "attempt_id": "d7e68286f56b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.440472Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.78941695485264, "ttft_ms": 11.508582974784076, "decode_ms": 11.591374990530312}, "total_wall_ms": 20652.00604114216, "ttft_ms": 11.508582974784076, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e18f2a58fbce166f190266a", "attempt_id": "a66e4550b950", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.681374Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 453, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.94341707974672, "ttft_ms": 11.617708951234818, "decode_ms": 22.87674997933209}, "total_wall_ms": 20663.58983318787, "ttft_ms": 11.617708951234818, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f2ce6f482e9f27ffae024381", "attempt_id": "dca34cf1804f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.932602Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 454, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 200.86958399042487, "ttft_ms": 11.52995799202472, "decode_ms": 11.586250038817525}, "total_wall_ms": 20651.094458065927, "ttft_ms": 11.52995799202472, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f4011ae97631851c3ee7e766", "attempt_id": "d466ff971558", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.172480Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 470, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.5193329686299, "ttft_ms": 11.535957921296358, "decode_ms": 11.52787497267127}, "total_wall_ms": 20654.727374087088, "ttft_ms": 11.535957921296358, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae4a65c8cac8fe92ce597634", "attempt_id": "ac2cc66452c4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.415617Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 203.30787496641278, "ttft_ms": 11.5481250686571, "decode_ms": 11.503709014505148}, "total_wall_ms": 20653.487000148743, "ttft_ms": 11.5481250686571, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b171b72fc315c9e512c9c1ab", "attempt_id": "df8d91e4625f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.657764Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 469, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 208.12520803883672, "ttft_ms": 11.61370798945427, "decode_ms": 11.469958000816405}, "total_wall_ms": 20658.339500194415, "ttft_ms": 11.61370798945427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "acc849b3d08b2c5057915d7c", "attempt_id": "43f3de5bba98", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.904469Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 465, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.23579204361886, "ttft_ms": 11.56979100778699, "decode_ms": 57.78304091654718}, "total_wall_ms": 20700.720541062765, "ttft_ms": 11.56979100778699, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,646,720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "2c0bb14ad8ba61e6d23fb3dea5205f2f02c43c95a0cf8e7f93c240ddea626ad4"} | ||||
| 6463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80b55c21aa769e11f06232e2", "attempt_id": "806784074db2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:22.193386Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 460, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 203.2241669949144, "ttft_ms": 11.535875033587217, "decode_ms": 11.553250020369887}, "total_wall_ms": 20653.444375027902, "ttft_ms": 11.535875033587217, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2045fa722f973b166629ff76", "attempt_id": "5194ab2ee3c4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:22.435091Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 464, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.76945908740163, "ttft_ms": 11.539041996002197, "decode_ms": 11.492499965243042}, "total_wall_ms": 20654.90045817569, "ttft_ms": 11.539041996002197, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "277cd0ddb1dc0228579c6f0b", "attempt_id": "5e894ac62eb3", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:22.678642Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 467, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.35237500350922, "ttft_ms": 11.583790997974575, "decode_ms": 11.511042015627027}, "total_wall_ms": 20654.59216607269, "ttft_ms": 11.583790997974575, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8684cca1bde15a7bf65cb552", "attempt_id": "66022a20a14e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:41.408286Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 452, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 200.94579097349197, "ttft_ms": 11.417291942052543, "decode_ms": 11.446291930042207}, "total_wall_ms": 39132.63620832004, "ttft_ms": 11.417291942052543, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5168a70642e8a5690249bd9b", "attempt_id": "f0c41f519d89", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:41.648717Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 200.74433297850192, "ttft_ms": 11.597416014410555, "decode_ms": 11.473416001535952}, "total_wall_ms": 39132.653500302695, "ttft_ms": 11.597416014410555, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b0c25fc019d195294f129824", "attempt_id": "8b740728e3ce", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:41.888559Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.5256670312956, "ttft_ms": 11.530166957527399, "decode_ms": 11.525416048243642}, "total_wall_ms": 39134.37458325643, "ttft_ms": 11.530166957527399, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0753c06f450b0678c6344cba", "attempt_id": "c09165b2ab24", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.129945Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 455, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 203.65537505131215, "ttft_ms": 11.6252499865368, "decode_ms": 11.536624981090426}, "total_wall_ms": 39135.623958311044, "ttft_ms": 11.6252499865368, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7658de8168a54706ea455ea9", "attempt_id": "ed79af2a252d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.372543Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 462, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 200.44012495782226, "ttft_ms": 11.534958030097187, "decode_ms": 11.554750031791627}, "total_wall_ms": 39132.342500262894, "ttft_ms": 11.534958030097187, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "86558a65a115b2723d2ca5d1", "attempt_id": "584f714fa3cd", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.611746Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 203.5017079906538, "ttft_ms": 11.600124998949468, "decode_ms": 11.545417015440762}, "total_wall_ms": 39135.43791731354, "ttft_ms": 11.600124998949468, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4705add754afca10dd943642", "attempt_id": "109062cabb54", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.854345Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 453, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.36729201860726, "ttft_ms": 11.570916045457125, "decode_ms": 23.007625015452504}, "total_wall_ms": 39145.730374148116, "ttft_ms": 11.570916045457125, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "29acfc567719fb94547bab5c", "attempt_id": "4e95b5ef1d66", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.106889Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 454, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.103832969442, "ttft_ms": 11.636374983936548, "decode_ms": 11.507041985169053}, "total_wall_ms": 39134.05295822304, "ttft_ms": 11.636374983936548, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "203b89cda76a88117927acfd", "attempt_id": "5d3ae8fda989", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.347861Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 470, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.15658308006823, "ttft_ms": 11.588749941438437, "decode_ms": 11.586457956582308}, "total_wall_ms": 39134.16225020774, "ttft_ms": 11.588749941438437, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb0112a54b2ab91530061881", "attempt_id": "b4625ba61717", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.588943Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 201.65483397431672, "ttft_ms": 11.532332981005311, "decode_ms": 11.554541997611523}, "total_wall_ms": 39133.52791615762, "ttft_ms": 11.532332981005311, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0ec1d9f0601ce9b0d52e097", "attempt_id": "f119ec23efa4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.829172Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 469, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 207.1392919169739, "ttft_ms": 11.553416028618813, "decode_ms": 11.523749912157655}, "total_wall_ms": 39139.00450034998, "ttft_ms": 11.553416028618813, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "12056658164e80e5b64a4408", "attempt_id": "6f8c86e6c2bc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.074741Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 465, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 203.10245803557336, "ttft_ms": 11.572084040381014, "decode_ms": 57.69333301577717}, "total_wall_ms": 39181.191000156105, "ttft_ms": 11.572084040381014, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,646,720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "2c0bb14ad8ba61e6d23fb3dea5205f2f02c43c95a0cf8e7f93c240ddea626ad4"} | ||||
| 6478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4c5ddf64c06c4bf305520ffd", "attempt_id": "985c363a0213", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.362681Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 460, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 201.77362498361617, "ttft_ms": 11.604042025282979, "decode_ms": 11.506457929499447}, "total_wall_ms": 39133.6852501845, "ttft_ms": 11.604042025282979, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "293149f634f67396053180ce", "attempt_id": "dcd61e6735b2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.603148Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 464, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 204.5530000468716, "ttft_ms": 11.566541972570121, "decode_ms": 11.507750023156404}, "total_wall_ms": 39136.406833305955, "ttft_ms": 11.566541972570121, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da6f4356196da5ddf1f1bc9f", "attempt_id": "c93620885371", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.846193Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 467, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 205.05233306903392, "ttft_ms": 11.624832986854017, "decode_ms": 11.526959016919136}, "total_wall_ms": 39136.99137524236, "ttft_ms": 11.624832986854017, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f94f53a18e209d47bfb8ddd", "attempt_id": "ec035f1a57c0", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.137546Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.33754105865955, "ttft_ms": 11.96925004478544, "decode_ms": 11.930791893973947}, "total_wall_ms": 7217.62954199221, "ttft_ms": 11.96925004478544, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6e4edc15fcdb423774811fe5", "attempt_id": "9b2dbf8d61df", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.405480Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.46345796622336, "ttft_ms": 11.999250040389597, "decode_ms": 11.93166698794812}, "total_wall_ms": 7217.751334072091, "ttft_ms": 11.999250040389597, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5dfa922561234f365efc4e06", "attempt_id": "b35ff64d0baa", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.673131Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.3631250243634, "ttft_ms": 11.959125055000186, "decode_ms": 83.38604203891009}, "total_wall_ms": 7288.033208111301, "ttft_ms": 11.959125055000186, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b5efa056aa8a9ab05e5a1ea1", "attempt_id": "8b686fd86132", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.010857Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.75329202320427, "ttft_ms": 11.945249978452921, "decode_ms": 12.137541081756353}, "total_wall_ms": 7217.132042045705, "ttft_ms": 11.945249978452921, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c837f57c51575c785d18044", "attempt_id": "0585fa7f8963", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.277268Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.10254206322134, "ttft_ms": 11.983082978986204, "decode_ms": 107.37483308184892}, "total_wall_ms": 7312.79041711241, "ttft_ms": 11.983082978986204, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 6486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df42cc1d9e3606b312e48498", "attempt_id": "ef899a5d9889", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.639445Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.3269579745829, "ttft_ms": 12.147915898822248, "decode_ms": 12.042958987876773}, "total_wall_ms": 7217.956667067483, "ttft_ms": 12.147915898822248, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6487 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71c20d3d7f450645cb2b88f2", "attempt_id": "4c0a3b666a66", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.906924Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.65075003169477, "ttft_ms": 11.850790935568511, "decode_ms": 11.824292014352977}, "total_wall_ms": 7216.691459063441, "ttft_ms": 11.850790935568511, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6488 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "20691cdd16bcd0ee2b7376ce", "attempt_id": "53cd8bbb4df2", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.173242Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.6510840272531, "ttft_ms": 12.024041963741183, "decode_ms": 11.98533398564905}, "total_wall_ms": 7216.995583148673, "ttft_ms": 12.024041963741183, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6489 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e325942b42e596df339f4ce2", "attempt_id": "b84a2ed3fc50", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.440186Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 229.6456249896437, "ttft_ms": 12.049874989315867, "decode_ms": 11.993665946647525}, "total_wall_ms": 7220.0570000568405, "ttft_ms": 12.049874989315867, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6490 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8992ac2d14527f84647b37e4", "attempt_id": "eba93941dcbd", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.709948Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.03824995551258, "ttft_ms": 12.024249997921288, "decode_ms": 11.960541014559567}, "total_wall_ms": 7217.3483750084415, "ttft_ms": 12.024249997921288, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6491 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "714a3b5afc6e23c38f513703", "attempt_id": "dc9527a73532", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.976827Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 229.2202499229461, "ttft_ms": 12.016541906632483, "decode_ms": 11.87279203440994}, "total_wall_ms": 7219.4512920686975, "ttft_ms": 12.016541906632483, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6492 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d242cfb6a8997d4430ef185c", "attempt_id": "2b7e40d65534", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:55.246057Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.04345802776515, "ttft_ms": 12.091790908016264, "decode_ms": 83.68970802985132}, "total_wall_ms": 7289.284917060286, "ttft_ms": 12.091790908016264, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 6493 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1464ad9d7ff02bdb87b9ffa8", "attempt_id": "3c39669a8a37", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:55.584340Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.7504578921944, "ttft_ms": 12.062042020261288, "decode_ms": 11.881207930855453}, "total_wall_ms": 7217.175125959329, "ttft_ms": 12.062042020261288, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6494 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9ab0b72e3db8ca45d469b799", "attempt_id": "a55451fc0127", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:55.851616Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.45554195716977, "ttft_ms": 12.18508300371468, "decode_ms": 12.01075001154095}, "total_wall_ms": 7218.157959054224, "ttft_ms": 12.18508300371468, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6495 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b56cb03e9a57414caae162ea", "attempt_id": "48c7a46ea91f", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:56.120825Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.2582909790799, "ttft_ms": 11.99937507044524, "decode_ms": 12.003959040157497}, "total_wall_ms": 7217.628707992844, "ttft_ms": 11.99937507044524, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6496 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "753f744d5590b2274579aaaa", "attempt_id": "3a6577be9302", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:02.774149Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.68308403808624, "ttft_ms": 11.846457957290113, "decode_ms": 11.902624974027276}, "total_wall_ms": 13600.601210142486, "ttft_ms": 11.846457957290113, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6497 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e39732132c6f0d74391922ec", "attempt_id": "20e5b09ce7ad", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.041491Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.7764579737559, "ttft_ms": 11.951458058319986, "decode_ms": 11.919416952878237}, "total_wall_ms": 13600.782084162347, "ttft_ms": 11.951458058319986, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6498 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "baeb2d37a0177444fe208edd", "attempt_id": "b5dd2a0849b9", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.308153Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.385583053343, "ttft_ms": 12.16383301652968, "decode_ms": 84.16995801962912}, "total_wall_ms": 13673.025210155174, "ttft_ms": 12.16383301652968, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6499 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5af9030e32b929ada6ae4d65", "attempt_id": "e81ec9708515", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.646825Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.614834042266, "ttft_ms": 12.10945809725672, "decode_ms": 12.029916979372501}, "total_wall_ms": 13601.05179308448, "ttft_ms": 12.10945809725672, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6500 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2b0289cc401be1a010b7970e", "attempt_id": "205c4aa8f5bd", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.914060Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.63891699630767, "ttft_ms": 11.959582916460931, "decode_ms": 107.48100001364946}, "total_wall_ms": 13696.246209088713, "ttft_ms": 11.959582916460931, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 6501 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49d09c2a99ad0f6c510fe16c", "attempt_id": "333621cb6a37", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:04.277096Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.90795792732388, "ttft_ms": 11.956249945797026, "decode_ms": 12.165375053882599}, "total_wall_ms": 13601.181835052557, "ttft_ms": 11.956249945797026, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6502 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e771788796b151bfd01affc6", "attempt_id": "adc35ad88ada", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:04.543903Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.6862919786945, "ttft_ms": 11.993833002634346, "decode_ms": 11.997084016911685}, "total_wall_ms": 13600.79825099092, "ttft_ms": 11.993833002634346, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6503 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a73dc4b558ae698227c1b34c", "attempt_id": "4fb299208db8", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:04.810395Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.766207953915, "ttft_ms": 11.945624952204525, "decode_ms": 11.92041696049273}, "total_wall_ms": 13600.741876056418, "ttft_ms": 11.945624952204525, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6504 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6779ed992be9c3bd7594f65c", "attempt_id": "be021fa9a18a", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.076781Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 229.57179101649672, "ttft_ms": 12.232957989908755, "decode_ms": 11.908375076018274}, "total_wall_ms": 13603.986417059787, "ttft_ms": 12.232957989908755, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6505 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9df0f4564d4b81ae7ac37146", "attempt_id": "54eec9ad4c02", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.346551Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.05583297647536, "ttft_ms": 12.183125014416873, "decode_ms": 11.90149993635714}, "total_wall_ms": 13601.28316807095, "ttft_ms": 12.183125014416873, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6506 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "75d767fc490e28cee390633b", "attempt_id": "7ea57903743a", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.613935Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 229.49620801955462, "ttft_ms": 11.895584058947861, "decode_ms": 11.921458994038403}, "total_wall_ms": 13603.455210104585, "ttft_ms": 11.895584058947861, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6507 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ba97a7bffcd10007b5c6a840", "attempt_id": "e914bfbd5cd2", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.883243Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.29645809158683, "ttft_ms": 11.892999988049269, "decode_ms": 83.18300009705126}, "total_wall_ms": 13672.52783512231, "ttft_ms": 11.892999988049269, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 6508 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02bd6a199cfb3648b21e2001", "attempt_id": "2cd7243371e7", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:06.221612Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.43054199963808, "ttft_ms": 11.801416985690594, "decode_ms": 11.833208962343633}, "total_wall_ms": 13601.18412610609, "ttft_ms": 11.801416985690594, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6509 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0e3ca81812ba9a2213a67243", "attempt_id": "f02994db75e3", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:06.488573Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.21154196187854, "ttft_ms": 11.821249965578318, "decode_ms": 11.791165918111801}, "total_wall_ms": 13600.940084084868, "ttft_ms": 11.821249965578318, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6510 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "77a55ff61a5cdb2f879b907c", "attempt_id": "7ff7f01f492d", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:06.754885Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.14358288794756, "ttft_ms": 11.809874908067286, "decode_ms": 11.813458055257797}, "total_wall_ms": 13600.895918090828, "ttft_ms": 11.809874908067286, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6511 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "726fbb3883c8b239a09d00f6", "attempt_id": "8bd825633ac5", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:19.667794Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.7713330220431, "ttft_ms": 11.888499953784049, "decode_ms": 11.843792046420276}, "total_wall_ms": 26244.002543156967, "ttft_ms": 11.888499953784049, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6512 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "408729447d65b602d16fda14", "attempt_id": "a416a32a0131", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:19.935054Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.02529199887067, "ttft_ms": 11.941000004298985, "decode_ms": 11.769249918870628}, "total_wall_ms": 26244.22429315746, "ttft_ms": 11.941000004298985, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6513 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8118c69625bce55bc1b63621", "attempt_id": "5e81113ab588", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:20.202408Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.03762503806502, "ttft_ms": 11.819500010460615, "decode_ms": 82.41174998693168}, "total_wall_ms": 26314.70904313028, "ttft_ms": 11.819500010460615, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6514 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b41c2cd136f522f97551146f", "attempt_id": "53ab612bb802", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:20.539873Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.2377500301227, "ttft_ms": 11.864291969686747, "decode_ms": 11.791291064582765}, "total_wall_ms": 26243.310668156482, "ttft_ms": 11.864291969686747, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6515 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9264f3eb2fa8e2bc881a3644", "attempt_id": "4cc7500fc678", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:20.805585Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.80370800662786, "ttft_ms": 11.763916932977736, "decode_ms": 105.7549580000341}, "total_wall_ms": 26337.785501149483, "ttft_ms": 11.763916932977736, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 6516 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "379fdd74771035e2eb6e28a3", "attempt_id": "bfabffb1648e", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.165503Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.89308295957744, "ttft_ms": 11.791458004154265, "decode_ms": 11.826207977719605}, "total_wall_ms": 26243.955460144207, "ttft_ms": 11.791458004154265, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6517 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a1c0cc02f0feb55977a59249", "attempt_id": "4b5e754b980d", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.431760Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.97441698983312, "ttft_ms": 11.828124988824129, "decode_ms": 11.864541913382709}, "total_wall_ms": 26244.10158523824, "ttft_ms": 11.828124988824129, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6518 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cfd7f566c9336b798f169eef", "attempt_id": "0d87558657c2", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.698172Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.1051249699667, "ttft_ms": 11.855500051751733, "decode_ms": 11.904416023753583}, "total_wall_ms": 26244.29912713822, "ttft_ms": 11.855500051751733, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6519 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a21f1bbe758ee8cef8f172c3", "attempt_id": "2cbd47ca92e9", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.965020Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 229.09416700713336, "ttft_ms": 11.718250112608075, "decode_ms": 11.877542012371123}, "total_wall_ms": 26246.146918158047, "ttft_ms": 11.718250112608075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6520 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "58d9a604baa62d519acba4ee", "attempt_id": "de7fc439cc86", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:22.233270Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.9183750031516, "ttft_ms": 11.839916929602623, "decode_ms": 11.85870892368257}, "total_wall_ms": 26244.057793170214, "ttft_ms": 11.839916929602623, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6521 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "73c3858f29e819400209778f", "attempt_id": "a32525a59de5", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:22.500143Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 229.04245904646814, "ttft_ms": 11.789832962676883, "decode_ms": 11.730375001206994}, "total_wall_ms": 26246.00646016188, "ttft_ms": 11.789832962676883, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6522 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "58d2d7acf81624a6f0c6dda3", "attempt_id": "c98af0ed5f82", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:22.768782Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.17649990227073, "ttft_ms": 12.067832984030247, "decode_ms": 82.63779198750854}, "total_wall_ms": 26315.369501244277, "ttft_ms": 12.067832984030247, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 6523 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "724f02747b38012dd4315efb", "attempt_id": "ab1a4f595e42", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:23.107341Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.6135000390932, "ttft_ms": 11.80862495675683, "decode_ms": 11.871666996739805}, "total_wall_ms": 26243.756584241055, "ttft_ms": 11.80862495675683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6524 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "21be50c1530487d70d7108d6", "attempt_id": "e8a6251fe433", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:23.373315Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.42879199702293, "ttft_ms": 11.861625011079013, "decode_ms": 11.85912499204278}, "total_wall_ms": 26243.610210251063, "ttft_ms": 11.861625011079013, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6525 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef5155954acc1c0016fa85be", "attempt_id": "c49f4b2a1761", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:23.639231Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.08595800213516, "ttft_ms": 12.17612496111542, "decode_ms": 11.82437501847744}, "total_wall_ms": 26244.54262619838, "ttft_ms": 12.17612496111542, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6526 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751370cd81892dd40de17903", "attempt_id": "769757d4d58d", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:49.213249Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 226.88433295115829, "ttft_ms": 12.047790922224522, "decode_ms": 11.889833025634289}, "total_wall_ms": 51545.84158421494, "ttft_ms": 12.047790922224522, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6527 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "880b3a3219cb96b64f4ccaf4", "attempt_id": "b087eaeacc35", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:49.480557Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.0825420273468, "ttft_ms": 11.990125058218837, "decode_ms": 11.91887492313981}, "total_wall_ms": 51545.9824182326, "ttft_ms": 11.990125058218837, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6528 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1dd3029f476bf30c5bc5707", "attempt_id": "bc96537f758d", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:49.747123Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.089999942109, "ttft_ms": 12.071042088791728, "decode_ms": 82.94683299027383}, "total_wall_ms": 51617.09904228337, "ttft_ms": 12.071042088791728, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6529 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "565e07b4e0655f8bacabac69", "attempt_id": "1b59b9220139", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.085031Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.21041610930115, "ttft_ms": 11.838041944429278, "decode_ms": 11.842875042930245}, "total_wall_ms": 51545.88004213292, "ttft_ms": 11.838041944429278, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6530 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6ce8280ab8b1f23b48b50e5", "attempt_id": "25daa4a443a8", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.351570Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.19112504273653, "ttft_ms": 11.835957993753254, "decode_ms": 106.63254198152572}, "total_wall_ms": 51640.638959244825, "ttft_ms": 11.835957993753254, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 6531 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b453767f8031f595750575f", "attempt_id": "a2ea420b2a16", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.712977Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.34225005842745, "ttft_ms": 11.902292026206851, "decode_ms": 11.866874992847443}, "total_wall_ms": 51546.0947091924, "ttft_ms": 11.902292026206851, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6532 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "113e37ab97f0e52acb231f53", "attempt_id": "3d0b15461043", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.979840Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 226.8207500455901, "ttft_ms": 11.867458000779152, "decode_ms": 11.909457971341908}, "total_wall_ms": 51545.57116725482, "ttft_ms": 11.867458000779152, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6533 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da5ac261e1d1012fb619c1c6", "attempt_id": "4a72e4c1f38c", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:51.245966Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 226.81791603099555, "ttft_ms": 12.087582959793508, "decode_ms": 11.90095895435661}, "total_wall_ms": 51545.81116826739, "ttft_ms": 12.087582959793508, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6534 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "203e68c27d9d23918f1d07cd", "attempt_id": "8c48eb1ca7ec", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:51.512118Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 228.855749941431, "ttft_ms": 12.015124899335206, "decode_ms": 11.869041016325355}, "total_wall_ms": 51547.71729221102, "ttft_ms": 12.015124899335206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6535 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "12e68f1843b22f3e1c63ca8f", "attempt_id": "fcc416ee8e86", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:51.780479Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.07966703455895, "ttft_ms": 12.022125069051981, "decode_ms": 11.914458009414375}, "total_wall_ms": 51546.01620929316, "ttft_ms": 12.022125069051981, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6536 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ec61b8c3502b3dd603f5b34", "attempt_id": "c2c2c824e6f2", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.047154Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 229.16283400263637, "ttft_ms": 11.858124984428287, "decode_ms": 11.946166981942952}, "total_wall_ms": 51547.945667174645, "ttft_ms": 11.858124984428287, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6537 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1d0d129ea06720cfa36d3a6f", "attempt_id": "68c3d99dd648", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.315792Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.40304097533226, "ttft_ms": 11.915542068891227, "decode_ms": 82.97120907809585}, "total_wall_ms": 51617.27400019299, "ttft_ms": 11.915542068891227, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 6538 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02c02a185e7fd154972915ca", "attempt_id": "f4d5caed64a8", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.653727Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.34025004319847, "ttft_ms": 11.922917095944285, "decode_ms": 11.88620796892792}, "total_wall_ms": 51546.11158417538, "ttft_ms": 11.922917095944285, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6539 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7372cffe659dae5fcf305de9", "attempt_id": "39d376023187", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.920359Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.38029202446342, "ttft_ms": 11.933458037674427, "decode_ms": 11.882791994139552}, "total_wall_ms": 51546.17308429442, "ttft_ms": 11.933458037674427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6540 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aaa3fa059e7f87cdad36afbb", "attempt_id": "d98f39344b57", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:53.186754Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.1588749717921, "ttft_ms": 11.959374998696148, "decode_ms": 11.879750061780214}, "total_wall_ms": 51545.975125278346, "ttft_ms": 11.959374998696148, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6541 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c0a46794d470a83dc5eaf06", "attempt_id": "f6a53a4ae398", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:00.391363Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.26933300681412, "ttft_ms": 11.80416694842279, "decode_ms": 11.790709104388952}, "total_wall_ms": 7124.787209089845, "ttft_ms": 11.80416694842279, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6542 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a054945779b95b752f6a5b5", "attempt_id": "b9fefcd8a26d", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:00.595688Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.79070798959583, "ttft_ms": 12.047125026583672, "decode_ms": 130.07595902308822}, "total_wall_ms": 7243.934668018483, "ttft_ms": 12.047125026583672, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 6543 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6c1dfbb4e681b18651889980", "attempt_id": "a001a2bb4d9c", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:00.918833Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 165.1084590703249, "ttft_ms": 11.83262502308935, "decode_ms": 11.728542041964829}, "total_wall_ms": 7125.536459032446, "ttft_ms": 11.83262502308935, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6544 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "002b83b453a65db7e45424d8", "attempt_id": "1dddba50ec46", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.124226Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.0583339612931, "ttft_ms": 12.081082910299301, "decode_ms": 11.792624951340258}, "total_wall_ms": 7124.9332500156015, "ttft_ms": 12.081082910299301, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6545 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "63e2b46825b1675b0b6f8fb1", "attempt_id": "f04a9c2fefc3", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.328199Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.67762493994087, "ttft_ms": 11.896417010575533, "decode_ms": 11.777332983911037}, "total_wall_ms": 7125.347375986166, "ttft_ms": 11.896417010575533, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6546 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eab56dedd883c8843d5ff1cb", "attempt_id": "903634cd4f59", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.533843Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 184.89924992900342, "ttft_ms": 12.040583998896182, "decode_ms": 11.881624930538237}, "total_wall_ms": 7145.81962605007, "ttft_ms": 12.040583998896182, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6547 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b8da8ea509495646817ef35e", "attempt_id": "e9cddc7c6db5", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.759234Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 439, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.23270793166012, "ttft_ms": 11.796916020102799, "decode_ms": 11.788291041739285}, "total_wall_ms": 7124.669751035981, "ttft_ms": 11.796916020102799, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6548 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bedfd838642aeacb43c7693e", "attempt_id": "16774b407c62", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.963156Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 441, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.2329579917714, "ttft_ms": 11.775291990488768, "decode_ms": 11.805000016465783}, "total_wall_ms": 7124.653875012882, "ttft_ms": 11.775291990488768, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6549 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0155b74fcff3d4ac35ff5f40", "attempt_id": "b6ea30e798b4", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.166460Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.86870795115829, "ttft_ms": 11.836208985187113, "decode_ms": 11.81591593194753}, "total_wall_ms": 7146.448876010254, "ttft_ms": 11.836208985187113, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6550 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ee38a8c6ca620154c4030cb8", "attempt_id": "d0c81646384e", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.392062Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 165.6753340503201, "ttft_ms": 11.78512501064688, "decode_ms": 82.25158299319446}, "total_wall_ms": 7196.570542058907, "ttft_ms": 11.78512501064688, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9134435", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "f7384892cb4f9a38f6115f91da5fec3f0d7e24e47877737b0f34e2b4a6af7d5a"} | ||||
| 6551 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c2ac17ce3dc8a07f36ec94ec", "attempt_id": "9e15ad02f4e2", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.667654Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.01112493686378, "ttft_ms": 11.85000000987202, "decode_ms": 11.756583000533283}, "total_wall_ms": 7145.507792942226, "ttft_ms": 11.85000000987202, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6552 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae74c942b2725919916b8221", "attempt_id": "786b6dceeadf", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.892070Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 184.76804194506258, "ttft_ms": 11.788417003117502, "decode_ms": 82.40608300548047}, "total_wall_ms": 7215.8218760741875, "ttft_ms": 11.788417003117502, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 6553 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6327d0f270950a8d968009a3", "attempt_id": "7f3d287266c7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:03.186225Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 165.31150008086115, "ttft_ms": 11.79787504952401, "decode_ms": 11.764207971282303}, "total_wall_ms": 7125.712918001227, "ttft_ms": 11.79787504952401, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6554 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "387acff2e427afe098414fcd", "attempt_id": "153b3034f20c", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:03.390365Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 452, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.54616696201265, "ttft_ms": 11.814708006568253, "decode_ms": 11.842208099551499}, "total_wall_ms": 7146.036084042862, "ttft_ms": 11.814708006568253, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6555 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2e89e7502d1437bc71263336", "attempt_id": "f89836bf53e4", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:03.614845Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.07358303759247, "ttft_ms": 11.805834015831351, "decode_ms": 11.80404203478247}, "total_wall_ms": 7145.520791993476, "ttft_ms": 11.805834015831351, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6556 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fadf6b80a3a17a3f7a9ffb6b", "attempt_id": "e2bf4ebd5cee", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:08.387120Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 165.30312492977828, "ttft_ms": 11.850125039927661, "decode_ms": 117.14154202491045}, "total_wall_ms": 11777.991416980512, "ttft_ms": 11.850125039927661, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | ||||
| 6557 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1feda63120a084bc52c6f3c", "attempt_id": "5d5d2a002589", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:08.698202Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.7597499145195, "ttft_ms": 12.01541698537767, "decode_ms": 129.88954095635563}, "total_wall_ms": 11810.371709056199, "ttft_ms": 12.01541698537767, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 6558 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "66066b99de29d4f4d57fa7c0", "attempt_id": "9636d61fa06e", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.041975Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.02974994387478, "ttft_ms": 11.894749943166971, "decode_ms": 11.993292020633817}, "total_wall_ms": 11691.599541925825, "ttft_ms": 11.894749943166971, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6559 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7e2ebc2683ad6e5785804f22", "attempt_id": "3589f293cda4", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.266158Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 164.52316695358604, "ttft_ms": 11.815292062237859, "decode_ms": 11.850083945319057}, "total_wall_ms": 11671.759251039475, "ttft_ms": 11.815292062237859, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6560 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50db5edd817167b057d9d502", "attempt_id": "92b62d67fc8f", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.470107Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.84904197975993, "ttft_ms": 11.632499983534217, "decode_ms": 11.661750031635165}, "total_wall_ms": 11691.708042053506, "ttft_ms": 11.632499983534217, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6561 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71337a6adc8a5870360ed22b", "attempt_id": "24fef414b72a", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.693550Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.38833293132484, "ttft_ms": 12.018500012345612, "decode_ms": 11.815333971753716}, "total_wall_ms": 11692.906376090832, "ttft_ms": 12.018500012345612, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6562 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "799e8a4d60036fcaf14ef86f", "attempt_id": "8057b02d18cf", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.918867Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 444, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 164.20979204121977, "ttft_ms": 11.923499987460673, "decode_ms": 11.82508294004947}, "total_wall_ms": 11671.63574998267, "ttft_ms": 11.923499987460673, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6563 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "abef668c0b7a6ccb6652cae4", "attempt_id": "446a113001eb", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.123429Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 164.78812508285046, "ttft_ms": 11.933541973121464, "decode_ms": 11.839375016279519}, "total_wall_ms": 11672.191416961141, "ttft_ms": 11.933541973121464, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6564 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2e1246988ad4c1c037916b9e", "attempt_id": "990405aa52e1", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.328215Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.66583306528628, "ttft_ms": 11.888416949659586, "decode_ms": 11.815374949947}, "total_wall_ms": 11693.00425099209, "ttft_ms": 11.888416949659586, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6565 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a0d4a27493151e512f10672", "attempt_id": "0bb8379b6927", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.553594Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.838708024472, "ttft_ms": 11.858458048664033, "decode_ms": 11.804417008534074}, "total_wall_ms": 11692.200417048298, "ttft_ms": 11.858458048664033, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6566 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "10079aa7ca414ab52eafb69e", "attempt_id": "e2ed84f5328f", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.777591Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 463, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.35545794293284, "ttft_ms": 11.964083067141473, "decode_ms": 11.907332926057279}, "total_wall_ms": 11692.946959054098, "ttft_ms": 11.964083067141473, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6567 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f1751334c61a6544fcf83837", "attempt_id": "570bba19f253", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.003711Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 456, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.12491695582867, "ttft_ms": 11.866500019095838, "decode_ms": 82.7463329769671}, "total_wall_ms": 11763.31404200755, "ttft_ms": 11.866500019095838, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 6568 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e89b2dcd24531c8826a8bab5", "attempt_id": "5beaba253e10", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.299335Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.42724999133497, "ttft_ms": 11.843333020806313, "decode_ms": 11.862916988320649}, "total_wall_ms": 11692.689917981625, "ttft_ms": 11.843333020806313, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6569 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fc6513c10527df06b064bcb0", "attempt_id": "818234321c94", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.523472Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.0474999519065, "ttft_ms": 11.861416045576334, "decode_ms": 11.87649997882545}, "total_wall_ms": 11692.399959079921, "ttft_ms": 11.861416045576334, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6570 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c1330581de4bcfb078be8cd3", "attempt_id": "4143f91773ab", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.748188Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.00295898411423, "ttft_ms": 11.922916048206389, "decode_ms": 11.834541917778552}, "total_wall_ms": 11692.35262600705, "ttft_ms": 11.922916048206389, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6571 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16860c18e815a31fc1d6290c", "attempt_id": "af19488cc824", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.095631Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.44495902396739, "ttft_ms": 11.853790958411992, "decode_ms": 12.021875008940697}, "total_wall_ms": 20792.664124979638, "ttft_ms": 11.853790958411992, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6572 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1b0632f3877eef1cdeffd83", "attempt_id": "d18f86d9645f", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.300363Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 184.59491699468344, "ttft_ms": 11.866250075399876, "decode_ms": 129.9334999639541}, "total_wall_ms": 20930.726041086018, "ttft_ms": 11.866250075399876, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 6573 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad77b3a14eb57439dd764b47", "attempt_id": "2ec5efef1d5e", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.642320Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 183.82549996022135, "ttft_ms": 11.845917091704905, "decode_ms": 11.891374946571887}, "total_wall_ms": 20811.870167031884, "ttft_ms": 11.845917091704905, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6574 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50c979e2fbd85e95a0c564d8", "attempt_id": "e23e623ad151", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.865499Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.1758339246735, "ttft_ms": 11.8742500199005, "decode_ms": 11.805207934230566}, "total_wall_ms": 20792.14008396957, "ttft_ms": 11.8742500199005, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6575 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "92f883c1e23f82b06a6a65f2", "attempt_id": "d3df79261999", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.068800Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.03374990541488, "ttft_ms": 11.841833009384573, "decode_ms": 11.808292008936405}, "total_wall_ms": 20812.969458987936, "ttft_ms": 11.841833009384573, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6576 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "349cca834979b7ec2d89e18e", "attempt_id": "7ec2854dbc72", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.292678Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.4181250091642, "ttft_ms": 11.826375033706427, "decode_ms": 11.85033400543034}, "total_wall_ms": 20813.36970801931, "ttft_ms": 11.826375033706427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6577 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a447592486df7a43f7858ee0", "attempt_id": "4ad05350b006", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.516739Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 444, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.16779207065701, "ttft_ms": 11.946332990191877, "decode_ms": 11.776415980421007}, "total_wall_ms": 20792.149875080213, "ttft_ms": 11.946332990191877, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6578 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90eccaf77c9a6a72aa1e095d", "attempt_id": "ffb7e7135bf0", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.719505Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.6102089434862, "ttft_ms": 11.85841707047075, "decode_ms": 11.880625039339066}, "total_wall_ms": 20792.62541711796, "ttft_ms": 11.85841707047075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6579 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "936324d65d8c0a69e0195c8d", "attempt_id": "b0e05e044c09", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.923247Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.19008299335837, "ttft_ms": 11.860250029712915, "decode_ms": 11.795790982432663}, "total_wall_ms": 20813.140416983515, "ttft_ms": 11.860250029712915, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6580 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "73ad64ba128ba84d04f6c580", "attempt_id": "03eaa230538e", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.147509Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 184.54370903782547, "ttft_ms": 11.871750000864267, "decode_ms": 11.827250011265278}, "total_wall_ms": 20812.533666961826, "ttft_ms": 11.871750000864267, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6581 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "22dacd8f2646ee15f7da5c41", "attempt_id": "3fb733cecad0", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.371012Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 463, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.72470801882446, "ttft_ms": 11.868500034324825, "decode_ms": 11.852708994410932}, "total_wall_ms": 20813.73854202684, "ttft_ms": 11.868500034324825, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6582 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7746f175dc12b1ba6e7f3a25", "attempt_id": "2d4c8067449c", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.595542Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 456, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.0237080361694, "ttft_ms": 11.849625036120415, "decode_ms": 82.70766702480614}, "total_wall_ms": 20883.87183402665, "ttft_ms": 11.849625036120415, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 6583 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "913c805305f049c259216d9e", "attempt_id": "87891aab8478", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.890402Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.41999999433756, "ttft_ms": 11.828709044493735, "decode_ms": 11.834709090180695}, "total_wall_ms": 20813.37879097555, "ttft_ms": 11.828709044493735, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6584 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d478b15190aca223b51f5c76", "attempt_id": "3e5fe5dde7f6", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:24.115247Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 184.9063750123605, "ttft_ms": 11.823124950751662, "decode_ms": 11.84625003952533}, "total_wall_ms": 20812.855791067705, "ttft_ms": 11.823124950751662, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6585 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cf124bb63534ad2b693d63c7", "attempt_id": "2b5c55ab6000", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:24.338817Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.54220802616328, "ttft_ms": 11.914875009097159, "decode_ms": 11.851749964989722}, "total_wall_ms": 20813.61258297693, "ttft_ms": 11.914875009097159, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6586 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "27407fe5ddd3bded10c90e65", "attempt_id": "29fc9dd12987", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:42.808196Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 164.1359580680728, "ttft_ms": 11.880041914992034, "decode_ms": 11.849083006381989}, "total_wall_ms": 39032.90354204364, "ttft_ms": 11.880041914992034, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6587 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55d70990fc57abdde8c1c8d5", "attempt_id": "ae05d511537a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.012743Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 184.66995900962502, "ttft_ms": 11.843707994557917, "decode_ms": 129.85899997875094}, "total_wall_ms": 39171.41804203857, "ttft_ms": 11.843707994557917, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 6588 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "befb512ec2e1301efd8e1569", "attempt_id": "55d8bcd5417a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.355125Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 184.86441601999104, "ttft_ms": 11.810792027972639, "decode_ms": 11.849874979816377}, "total_wall_ms": 39053.5123340087, "ttft_ms": 11.810792027972639, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6589 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "221f2a58197af486576ea3fa", "attempt_id": "7cd0aaa92bbc", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.579415Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 164.83379201963544, "ttft_ms": 11.806166963651776, "decode_ms": 11.875291005708277}, "total_wall_ms": 39033.50550006144, "ttft_ms": 11.806166963651776, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6590 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4f91af91cf769eed164604b9", "attempt_id": "754de6a6eaf6", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.783284Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.05345797166228, "ttft_ms": 11.875708936713636, "decode_ms": 12.00695801526308}, "total_wall_ms": 39053.94362506922, "ttft_ms": 11.875708936713636, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6591 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "73f47c6d5c89beeb639b5467", "attempt_id": "3471a8240b39", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.007696Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.17374992370605, "ttft_ms": 11.88095798715949, "decode_ms": 11.854749987833202}, "total_wall_ms": 39053.93200099934, "ttft_ms": 11.88095798715949, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6592 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df07df6dea0cf6065addfa76", "attempt_id": "733b36c45770", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.231889Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 444, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 164.25391589291394, "ttft_ms": 11.809166986495256, "decode_ms": 11.838875012472272}, "total_wall_ms": 39032.8872500686, "ttft_ms": 11.809166986495256, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6593 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab9e8dba7be7b85d63382125", "attempt_id": "ff1491509e5e", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.435308Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 165.02370801754296, "ttft_ms": 11.89695904031396, "decode_ms": 11.877209064550698}, "total_wall_ms": 39033.79162505735, "ttft_ms": 11.89695904031396, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6594 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "52fa2b2c3cb580da7ec91eef", "attempt_id": "92f1081e2251", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.639515Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.40212500374764, "ttft_ms": 11.866374989040196, "decode_ms": 11.911208042874932}, "total_wall_ms": 39054.18004200328, "ttft_ms": 11.866374989040196, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6595 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "70862c8c72ebe95f2f2bb9b5", "attempt_id": "6e7c77d22f4b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.864096Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.03620906267315, "ttft_ms": 11.9964579353109, "decode_ms": 12.023207964375615}, "total_wall_ms": 39054.06704195775, "ttft_ms": 11.9964579353109, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6596 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2dc0a964239c683b3f179055", "attempt_id": "c4b0d24a0d0b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.088682Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 463, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.9790829475969, "ttft_ms": 12.004542048089206, "decode_ms": 11.836834019050002}, "total_wall_ms": 39054.81691705063, "ttft_ms": 12.004542048089206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6597 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3caaad1c53a1ddb32a816a58", "attempt_id": "3a00a9188b29", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.313751Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 456, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.0465410389006, "ttft_ms": 11.896957992576063, "decode_ms": 82.89233292452991}, "total_wall_ms": 39124.85325103626, "ttft_ms": 11.896957992576063, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 6598 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "79fb8fd228a9c85c726bd42f", "attempt_id": "e7ec78e988b7", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.609438Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 184.29700005799532, "ttft_ms": 11.732916929759085, "decode_ms": 11.949750012718141}, "total_wall_ms": 39053.147459053434, "ttft_ms": 11.732916929759085, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6599 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c97d85eed8d58bde93d7c368", "attempt_id": "24ad152e9ec5", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.833559Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.73754199314862, "ttft_ms": 11.87799999024719, "decode_ms": 11.943457997404039}, "total_wall_ms": 39054.58787502721, "ttft_ms": 11.87799999024719, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6600 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6b0507a68f2d9d20b2279c54", "attempt_id": "38e783ff4ab5", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:46.059629Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.37674995604903, "ttft_ms": 11.859874939545989, "decode_ms": 11.881249956786633}, "total_wall_ms": 39054.13695902098, "ttft_ms": 11.859874939545989, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6601 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecc468121b857927f149d66b", "attempt_id": "7b3835396b72", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:53.231843Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.01366699766368, "ttft_ms": 11.890541994944215, "decode_ms": 12.150709051638842}, "total_wall_ms": 7196.774625102989, "ttft_ms": 11.890541994944215, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6602 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9c81ead6074b873905fcace", "attempt_id": "36ba97098c36", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:53.499518Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.2832499584183, "ttft_ms": 11.905667022801936, "decode_ms": 12.08170794416219}, "total_wall_ms": 7196.945791016333, "ttft_ms": 11.905667022801936, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6603 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0aa9738e1cb9411ae4f12633", "attempt_id": "adf434ace87d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:53.766828Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.04312507994473, "ttft_ms": 11.928042047657073, "decode_ms": 83.2612500526011}, "total_wall_ms": 7267.958375043236, "ttft_ms": 11.928042047657073, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6604 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b819f4cf4d70789765f56d45", "attempt_id": "72973140ba2c", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:54.104944Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 226.95950011257082, "ttft_ms": 12.000125017948449, "decode_ms": 11.916665942408144}, "total_wall_ms": 7196.552124922164, "ttft_ms": 12.000125017948449, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6605 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9aa49802748ba50ac7ef879f", "attempt_id": "ea79a43d161d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:54.371379Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.11995895951986, "ttft_ms": 11.928292107768357, "decode_ms": 107.15870803687721}, "total_wall_ms": 7291.916416957974, "ttft_ms": 11.928292107768357, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 6606 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b4e0a18d8c2966c1ad66e40e", "attempt_id": "b38a9e749d7a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:54.733269Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.19416697509587, "ttft_ms": 11.907875072211027, "decode_ms": 11.93504105322063}, "total_wall_ms": 7196.724709006958, "ttft_ms": 11.907875072211027, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6607 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a00451a766a29b7098803d89", "attempt_id": "3727adecc409", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.000408Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 226.95954202208668, "ttft_ms": 12.039124965667725, "decode_ms": 11.90358295571059}, "total_wall_ms": 7196.595625020564, "ttft_ms": 12.039124965667725, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6608 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f2baa60c53536a3dd4482fbe", "attempt_id": "5121887d28f2", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.267121Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.23612503614277, "ttft_ms": 11.964207980781794, "decode_ms": 11.92641700617969}, "total_wall_ms": 7196.817999938503, "ttft_ms": 11.964207980781794, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6609 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e2159de9daf206c7825ef1d", "attempt_id": "6c9a6172f2ee", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.533946Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 229.46875006891787, "ttft_ms": 11.937875067815185, "decode_ms": 11.968082981184125}, "total_wall_ms": 7199.072916992009, "ttft_ms": 11.937875067815185, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6610 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1c2d6f113f606cf9fbcb401b", "attempt_id": "3b8cc8974e49", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.803170Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.52887499518692, "ttft_ms": 11.987083009444177, "decode_ms": 11.924542021006346}, "total_wall_ms": 7197.124334052205, "ttft_ms": 11.987083009444177, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6611 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "84e974276dc7ae1c7f8ac55b", "attempt_id": "0210cc9c3b1b", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.070518Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 229.18304102495313, "ttft_ms": 12.186208041384816, "decode_ms": 12.122917105443776}, "total_wall_ms": 7199.391000089236, "ttft_ms": 12.186208041384816, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6612 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "661a3cebc51120ec584eec23", "attempt_id": "9874aa566701", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.340077Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 226.54004103969783, "ttft_ms": 12.3287090100348, "decode_ms": 84.38154100440443}, "total_wall_ms": 7269.193916930817, "ttft_ms": 12.3287090100348, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 6613 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "40b645465198bd7914f472e1", "attempt_id": "800fc667bc14", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.680556Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.1463330835104, "ttft_ms": 12.037250096909702, "decode_ms": 11.95787510368973}, "total_wall_ms": 7196.986290975474, "ttft_ms": 12.037250096909702, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6614 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4182d2221720c6ea031a231d", "attempt_id": "e07e62f59299", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.948105Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.4645830038935, "ttft_ms": 12.003249954432249, "decode_ms": 11.94899994879961}, "total_wall_ms": 7197.1197499660775, "ttft_ms": 12.003249954432249, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6615 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7f5eccb5b99d80bd36304cc", "attempt_id": "26ab68fe59b4", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:57.215664Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.46837500017136, "ttft_ms": 11.944042053073645, "decode_ms": 11.833416996523738}, "total_wall_ms": 7196.95229199715, "ttft_ms": 11.944042053073645, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6616 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ddd0a2ed0dcb48c768ecfe32", "attempt_id": "4d72fc89187d", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.013453Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.34804202243686, "ttft_ms": 12.367833056487143, "decode_ms": 12.113792006857693}, "total_wall_ms": 13725.749083911069, "ttft_ms": 12.367833056487143, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6617 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9b17bc6001af4428d4595a97", "attempt_id": "1aafde050649", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.281307Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.9915830111131, "ttft_ms": 11.986832949332893, "decode_ms": 11.93108398001641}, "total_wall_ms": 13725.823416025378, "ttft_ms": 11.986832949332893, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6618 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ca1ccfe4498967618aac5e4c", "attempt_id": "65c3b66a4269", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.550550Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.24337503314018, "ttft_ms": 12.113417033106089, "decode_ms": 83.23362492956221}, "total_wall_ms": 13797.474874998443, "ttft_ms": 12.113417033106089, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6619 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1495cd4007f1a99adeea5c5c", "attempt_id": "bff779179295", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.890664Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.6717499587685, "ttft_ms": 12.021500035189092, "decode_ms": 11.90883293747902}, "total_wall_ms": 13725.447041913867, "ttft_ms": 12.021500035189092, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6620 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "82923a9b27c5c4f3b4d0441f", "attempt_id": "ddcb031505aa", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:05.158105Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.34483401291072, "ttft_ms": 11.980792041867971, "decode_ms": 106.91137495450675}, "total_wall_ms": 13821.044415934011, "ttft_ms": 11.980792041867971, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 6621 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "de38db94279fbc7af8908fe2", "attempt_id": "5add0cc8521f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:05.520929Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.1708749467507, "ttft_ms": 11.961457901634276, "decode_ms": 11.95499999448657}, "total_wall_ms": 13725.830999901518, "ttft_ms": 11.961457901634276, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6622 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1649ac1afc6a9df21ecf9663", "attempt_id": "7aec67e491fc", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:05.788330Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.8016659654677, "ttft_ms": 12.11179094389081, "decode_ms": 11.98212499730289}, "total_wall_ms": 13725.765916984528, "ttft_ms": 12.11179094389081, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6623 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "699107816d669f7e0a3e23bf", "attempt_id": "cf01b5e3dfa8", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.055667Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.28991694748402, "ttft_ms": 11.97016704827547, "decode_ms": 11.920665972866118}, "total_wall_ms": 13725.915541988797, "ttft_ms": 11.97016704827547, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6624 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b0a2af98e6361b232020b4c4", "attempt_id": "46a607b531bf", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.323338Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 228.967540897429, "ttft_ms": 12.09699991159141, "decode_ms": 11.913041002117097}, "total_wall_ms": 13727.846957975999, "ttft_ms": 12.09699991159141, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6625 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "697645ece476866d837fffc0", "attempt_id": "99cace8fee14", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.592848Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.57745801936835, "ttft_ms": 11.894499999471009, "decode_ms": 11.974791996181011}, "total_wall_ms": 13726.162582985125, "ttft_ms": 11.894499999471009, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6626 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5ac5245051f19929cba1156", "attempt_id": "4b7586d36fe7", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.860923Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 229.3671660590917, "ttft_ms": 12.044333037920296, "decode_ms": 11.911208974197507}, "total_wall_ms": 13728.087250026874, "ttft_ms": 12.044333037920296, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6627 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "77d547e0da4a676a516b25c6", "attempt_id": "51a62505c708", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:07.130124Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.38770802970976, "ttft_ms": 11.881542042829096, "decode_ms": 118.59470896888524}, "total_wall_ms": 13832.722624996677, "ttft_ms": 11.881542042829096, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27,310,344", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "57d43335b2f7697d49fa5c54ca28131a174ade7ed50cefb8f9e04bda80bbc15f"} | ||||
| 6628 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "edfe6182ed4c363a784dd7c1", "attempt_id": "65819bfa9800", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:07.504845Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.63245897274464, "ttft_ms": 12.079125037416816, "decode_ms": 11.959875002503395}, "total_wall_ms": 13725.523082888685, "ttft_ms": 12.079125037416816, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6629 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d36780001f0d8386b12bcfac", "attempt_id": "e8e4161722b4", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:07.772870Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.955582969822, "ttft_ms": 12.005541939288378, "decode_ms": 11.948833940550685}, "total_wall_ms": 13725.715999957174, "ttft_ms": 12.005541939288378, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6630 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a217c7fd0a62d0e3230eb17", "attempt_id": "c7eec7c6324c", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:08.040485Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.89295804593712, "ttft_ms": 11.957416078075767, "decode_ms": 12.158999918028712}, "total_wall_ms": 13725.748124998063, "ttft_ms": 11.957416078075767, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6631 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "379d5b5538ae30643f5249ce", "attempt_id": "4e381c78dd68", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.167322Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 208.06799991987646, "ttft_ms": 11.886875028721988, "decode_ms": 11.92337495740503}, "total_wall_ms": 25563.275250140578, "ttft_ms": 11.886875028721988, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6632 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2c7b1e8d752a7e243d1cff05", "attempt_id": "824e30cca4ae", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.416122Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.17608302645385, "ttft_ms": 11.901749996468425, "decode_ms": 12.00404204428196}, "total_wall_ms": 25565.47687505372, "ttft_ms": 11.901749996468425, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6633 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6812f7a2ba1cd68f1088eebc", "attempt_id": "74b109fd16e8", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.666282Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.53391590248793, "ttft_ms": 11.850791983306408, "decode_ms": 82.68633403349668}, "total_wall_ms": 25636.444958043285, "ttft_ms": 11.850791983306408, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6634 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dd5d7c7d7fad46dc6f565997", "attempt_id": "7839c04733a4", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.986940Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 208.44499999657273, "ttft_ms": 11.90079189836979, "decode_ms": 11.803834000602365}, "total_wall_ms": 25563.497915980406, "ttft_ms": 11.90079189836979, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6635 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4904ba7a72aa51f181f35b71", "attempt_id": "f3940cc5f46a", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:21.234778Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 551, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.2336250245571, "ttft_ms": 11.869499925523996, "decode_ms": 83.0089170485735}, "total_wall_ms": 25636.500083026476, "ttft_ms": 11.869499925523996, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | ||||
| 6636 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7aff21c6616007f66536f0bc", "attempt_id": "95fa376ca579", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:21.555236Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 555, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.08454205002636, "ttft_ms": 12.00154097750783, "decode_ms": 11.829583090730011}, "total_wall_ms": 25565.407915972173, "ttft_ms": 12.00154097750783, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6637 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fbe8fa88274efe34defa866d", "attempt_id": "c91fc282df52", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:21.804851Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 544, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 208.07570801116526, "ttft_ms": 11.908499989658594, "decode_ms": 11.832666001282632}, "total_wall_ms": 25563.19179199636, "ttft_ms": 11.908499989658594, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6638 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5a9c19b242f372562c2c431", "attempt_id": "88073ca7b4d6", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.053383Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 546, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 209.97550000902265, "ttft_ms": 11.934541980735958, "decode_ms": 11.87483302783221}, "total_wall_ms": 25565.17512514256, "ttft_ms": 11.934541980735958, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6639 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "96fd33520dbff2c8001b3994", "attempt_id": "a8507bd06d42", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.303034Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 562, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.991624975577, "ttft_ms": 11.858333018608391, "decode_ms": 11.896957992576063}, "total_wall_ms": 25566.133375046775, "ttft_ms": 11.858333018608391, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6640 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c23ef4c124ac921da98151db", "attempt_id": "536dd7bb37ab", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.553423Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.20912495441735, "ttft_ms": 11.930332984775305, "decode_ms": 11.827250011265278}, "total_wall_ms": 25565.332373953424, "ttft_ms": 11.930332984775305, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6641 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36ba732ea4cfc41cc1d732ce", "attempt_id": "1e5a75f88d73", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.803404Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 563, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.91000002343208, "ttft_ms": 11.837874888442457, "decode_ms": 71.11466606147587}, "total_wall_ms": 25625.217791064642, "ttft_ms": 11.837874888442457, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quilun-16", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "34a7c0e11c93ba75eb4b20d3d3f5303b417856d89a232e8b16fef75c4336afc6"} | ||||
| 6642 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0b5796cbe429684200f5e2e", "attempt_id": "7371af8583c7", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.113146Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 556, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.468832985498, "ttft_ms": 11.858290992677212, "decode_ms": 118.48804203327745}, "total_wall_ms": 25672.169915982522, "ttft_ms": 11.858290992677212, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37,154,259", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "475e1c30b81f429f1ab8d86eb02313598a196f4663b8300f83f9721827c72fa2"} | ||||
| 6643 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9711e0131a0cd3d701c0574b", "attempt_id": "7b1bf9d26ee2", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.469497Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.56908403988928, "ttft_ms": 11.872458970174193, "decode_ms": 11.849624919705093}, "total_wall_ms": 25565.627333009616, "ttft_ms": 11.872458970174193, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6644 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d0b7c8d4571db28f7ac5b1e1", "attempt_id": "f50266f7a39b", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.719579Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 557, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.87249997071922, "ttft_ms": 11.962375021539629, "decode_ms": 11.809041956439614}, "total_wall_ms": 25565.994290984236, "ttft_ms": 11.962375021539629, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6645 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "adb01e79b0bbb1677e43af85", "attempt_id": "bf93f950cae7", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.970052Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 558, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.50145791377872, "ttft_ms": 11.901709018275142, "decode_ms": 11.903250007890165}, "total_wall_ms": 25565.673999954015, "ttft_ms": 11.901709018275142, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6646 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea9d7975f67b5aeb7c411aa4", "attempt_id": "63f6e7b49bf5", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:47.857837Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 208.17083399742842, "ttft_ms": 11.87329099047929, "decode_ms": 11.856459081172943}, "total_wall_ms": 49195.238958112895, "ttft_ms": 11.87329099047929, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6647 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4a6ccde7d05e2f611db92b53", "attempt_id": "a67b54cc6126", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.106543Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.02850006334484, "ttft_ms": 11.856041965074837, "decode_ms": 11.861832928843796}, "total_wall_ms": 49197.0619171625, "ttft_ms": 11.856041965074837, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6648 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "07212d7317ff3732c632195e", "attempt_id": "4fa869a32a56", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.356141Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 209.67208303045481, "ttft_ms": 12.14137498755008, "decode_ms": 82.86954194772989}, "total_wall_ms": 49268.13470805064, "ttft_ms": 12.14137498755008, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6649 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36371940b36eea642b4e07dc", "attempt_id": "6cfe80fcc392", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.676719Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 208.0312919570133, "ttft_ms": 11.740374960936606, "decode_ms": 11.79654209408909}, "total_wall_ms": 49194.9811251834, "ttft_ms": 11.740374960936606, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6650 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8745caef4dfc82a81e2f64d", "attempt_id": "0604157bcc5a", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.924806Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 551, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 209.74558300804347, "ttft_ms": 12.021249975077808, "decode_ms": 83.20454100612551}, "total_wall_ms": 49268.38666712865, "ttft_ms": 12.021249975077808, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | ||||
| 6651 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a59db27d10289109f0328a0", "attempt_id": "88fa2190d8c9", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.247229Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 555, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.0943330442533, "ttft_ms": 12.061125016771257, "decode_ms": 11.999916983768344}, "total_wall_ms": 49197.596250101924, "ttft_ms": 12.061125016771257, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6652 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef45120307fc2266b11d8af7", "attempt_id": "825a9c93c631", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.498147Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 544, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 208.67200009524822, "ttft_ms": 11.841083061881363, "decode_ms": 11.896749958395958}, "total_wall_ms": 49195.72095805779, "ttft_ms": 11.841083061881363, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6653 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c42dad7e95de16e07f29fb97", "attempt_id": "40addd9b02ed", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.746514Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 546, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 209.4325409270823, "ttft_ms": 11.94883300922811, "decode_ms": 11.900707962922752}, "total_wall_ms": 49196.7768331524, "ttft_ms": 11.94883300922811, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6654 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f198d3f2f095fad3afbaf7f", "attempt_id": "cab9b981316d", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.995401Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 562, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.71041701361537, "ttft_ms": 11.958374991081655, "decode_ms": 11.919458978809416}, "total_wall_ms": 49198.026416124776, "ttft_ms": 11.958374991081655, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6655 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d4d9d8d1c6fd7c1ad0c4ed9", "attempt_id": "2f9274536f77", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:50.247543Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.1943331072107, "ttft_ms": 11.87558297533542, "decode_ms": 11.915415991097689}, "total_wall_ms": 49197.29508308228, "ttft_ms": 11.87558297533542, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6656 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df9b49b6ec627d80b0d980e4", "attempt_id": "47faad5bae03", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:50.497767Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 563, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.931958979927, "ttft_ms": 11.847249930724502, "decode_ms": 71.27329206559807}, "total_wall_ms": 49257.371041108854, "ttft_ms": 11.847249930724502, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quilun-16", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "34a7c0e11c93ba75eb4b20d3d3f5303b417856d89a232e8b16fef75c4336afc6"} | ||||
| 6657 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0745a7b15a0f41255c0e8386", "attempt_id": "a745c3d814c7", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:50.807671Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 556, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.0283340550959, "ttft_ms": 11.9330829475075, "decode_ms": 82.78916694689542}, "total_wall_ms": 49268.15895806067, "ttft_ms": 11.9330829475075, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3354484", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "5bf31ed3819d2b67352d6e22ea7f16de2ebd589c8281b4393305795b432156e3"} | ||||
| 6658 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7c25e5cad91c4ab6c6c925d0", "attempt_id": "b401e3571008", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:51.128413Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.57270793244243, "ttft_ms": 11.816957965493202, "decode_ms": 11.756874970160425}, "total_wall_ms": 49197.45633320417, "ttft_ms": 11.816957965493202, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6659 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "20b59930dcbddc00065ce674", "attempt_id": "3a1820a0b83c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:51.378907Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 557, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.54037509020418, "ttft_ms": 11.821750085800886, "decode_ms": 11.873625102452934}, "total_wall_ms": 49197.53104215488, "ttft_ms": 11.821750085800886, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6660 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c558c630043a4780c8416796", "attempt_id": "8b2e9c1fd8ce", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:51.628891Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 558, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.47225000802428, "ttft_ms": 11.869207955896854, "decode_ms": 11.876833974383771}, "total_wall_ms": 49197.51333317254, "ttft_ms": 11.869207955896854, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6661 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03c853b60429fefd8c52404b", "attempt_id": "f3083fa0756a", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:58.819090Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.517541998066, "ttft_ms": 11.817041086032987, "decode_ms": 11.78620895370841}, "total_wall_ms": 7127.00237496756, "ttft_ms": 11.817041086032987, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6662 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "659546d3c6c8e91434e91120", "attempt_id": "8693fef81a0f", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.024065Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.25012499187142, "ttft_ms": 11.77537499461323, "decode_ms": 129.4018329354003}, "total_wall_ms": 7245.301707996987, "ttft_ms": 11.77537499461323, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 6663 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc2dfe32753ea89d44e1cfdb", "attempt_id": "decac8927b3c", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.345970Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 163.9936660649255, "ttft_ms": 12.05391704570502, "decode_ms": 11.81683293543756}, "total_wall_ms": 7126.827500062063, "ttft_ms": 12.05391704570502, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6664 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "004f79a48f8bb5ef4b629de6", "attempt_id": "d3f7582f8d23", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.549814Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.43112504202873, "ttft_ms": 11.818542028777301, "decode_ms": 11.775457998737693}, "total_wall_ms": 7126.878416980617, "ttft_ms": 11.818542028777301, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6665 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef81e1358ba9280b1dea01fd", "attempt_id": "8f1be55433c9", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.753823Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.45770806260407, "ttft_ms": 11.775291990488768, "decode_ms": 11.769125005230308}, "total_wall_ms": 7127.935083000921, "ttft_ms": 11.775291990488768, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6666 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be1e71ee029391c89409175a", "attempt_id": "3253db3564f0", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.958096Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 184.9020830122754, "ttft_ms": 11.921457946300507, "decode_ms": 11.848208028823137}, "total_wall_ms": 7147.635500063188, "ttft_ms": 11.921457946300507, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6667 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "67a19ff324af232bb43044d8", "attempt_id": "717ea252564c", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.183591Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 439, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.2949590459466, "ttft_ms": 11.728540994226933, "decode_ms": 11.765125091187656}, "total_wall_ms": 7126.6367910429835, "ttft_ms": 11.728540994226933, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6668 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b75b646c7ae9de3e5b1d391", "attempt_id": "1e949e438fa2", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.387686Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 441, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.01404200587422, "ttft_ms": 11.757125030271709, "decode_ms": 12.009124970063567}, "total_wall_ms": 7126.621874049306, "ttft_ms": 11.757125030271709, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6669 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9764778f1bc324f5bda62993", "attempt_id": "b6d39c828995", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.590799Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.68837502971292, "ttft_ms": 11.77166705019772, "decode_ms": 11.99179096147418}, "total_wall_ms": 7148.304958012886, "ttft_ms": 11.77166705019772, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6670 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a97c4ba1dcaebb932af7be3a", "attempt_id": "c40ddb710540", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.815836Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.8008329104632, "ttft_ms": 11.785916984081268, "decode_ms": 82.51291699707508}, "total_wall_ms": 7198.933623963967, "ttft_ms": 11.785916984081268, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9134435", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "f7384892cb4f9a38f6115f91da5fec3f0d7e24e47877737b0f34e2b4a6af7d5a"} | ||||
| 6671 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fffda64207b098973f304634", "attempt_id": "67c02ab41338", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.091262Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.10133295785636, "ttft_ms": 11.834957986138761, "decode_ms": 11.790541000664234}, "total_wall_ms": 7147.569333086722, "ttft_ms": 11.834957986138761, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6672 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e91412e5d9c632cab392f9a9", "attempt_id": "29e2b1f997f6", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.315207Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.14366704039276, "ttft_ms": 11.891166912391782, "decode_ms": 82.28991692885756}, "total_wall_ms": 7218.1846658932045, "ttft_ms": 11.891166912391782, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 6673 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "febf4ecb58a79ecb171e348b", "attempt_id": "ee03eea820ea", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.610181Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.15287500806153, "ttft_ms": 11.796292033977807, "decode_ms": 11.700666975229979}, "total_wall_ms": 7127.4879990378395, "ttft_ms": 11.796292033977807, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6674 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "350140ff476429db88de04c7", "attempt_id": "23321660e55c", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.814094Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 452, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 184.93266601581126, "ttft_ms": 11.85204100329429, "decode_ms": 11.755957966670394}, "total_wall_ms": 7147.374207968824, "ttft_ms": 11.85204100329429, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6675 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ac0be4f793cfcc69f6eb9d91", "attempt_id": "560c357d500b", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:02.037931Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.35120808519423, "ttft_ms": 11.818500002846122, "decode_ms": 11.868750094436109}, "total_wall_ms": 7147.877166979015, "ttft_ms": 11.818500002846122, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6676 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "424b07858953312ca1a64299", "attempt_id": "9ee8b429de25", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:06.965140Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 164.64054200332612, "ttft_ms": 11.968332924880087, "decode_ms": 117.66037496272475}, "total_wall_ms": 11934.194498928264, "ttft_ms": 11.968332924880087, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | ||||
| 6677 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90531576983c730896a68ce8", "attempt_id": "70f45377c44e", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:07.277076Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.25383400265127, "ttft_ms": 11.858458979986608, "decode_ms": 129.4203749857843}, "total_wall_ms": 11966.401290032081, "ttft_ms": 11.858458979986608, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 6678 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751f2ecaa99dfeda54c9e58c", "attempt_id": "ce660dedb179", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:07.619905Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.57770806364715, "ttft_ms": 11.873041046783328, "decode_ms": 11.823041015304625}, "total_wall_ms": 11849.075665930286, "ttft_ms": 11.873041046783328, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6679 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ebaec1a7648c85c400d6e572", "attempt_id": "40f1875644a1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:07.844850Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 164.29262491874397, "ttft_ms": 11.786874965764582, "decode_ms": 11.796750011853874}, "total_wall_ms": 11827.676290995441, "ttft_ms": 11.786874965764582, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6680 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "81891eb09c27b34cffe6a7a9", "attempt_id": "6add956523f0", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.048199Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.66891690716147, "ttft_ms": 11.844040942378342, "decode_ms": 11.776958010159433}, "total_wall_ms": 11849.090290954337, "ttft_ms": 11.844040942378342, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6681 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c6169ee6a443339438e23875", "attempt_id": "a57ee2e3f66d", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.272554Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 459, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.2607079781592, "ttft_ms": 12.044250033795834, "decode_ms": 11.8002500385046}, "total_wall_ms": 11849.064249079674, "ttft_ms": 12.044250033795834, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6682 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0aa0f2ff17d00ee0b5b8816", "attempt_id": "b609613785cd", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.497533Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 165.24495801422745, "ttft_ms": 11.977125075645745, "decode_ms": 11.791958939284086}, "total_wall_ms": 11828.95158289466, "ttft_ms": 11.977125075645745, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6683 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e0899cf79f0f7cd52286d1f5", "attempt_id": "cc06d91f470c", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.703516Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 184.92145801428705, "ttft_ms": 11.808958952315152, "decode_ms": 11.843875050544739}, "total_wall_ms": 11848.410123959184, "ttft_ms": 11.808958952315152, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6684 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4afaca2b78a5a2420a6246ac", "attempt_id": "ed1e17cb3579", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.928038Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.9617909649387, "ttft_ms": 11.853833915665746, "decode_ms": 11.820040992461145}, "total_wall_ms": 11849.50516500976, "ttft_ms": 11.853833915665746, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6685 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "45e5d22c0f88b0f7dafad5f5", "attempt_id": "aa199fc05bbc", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.153414Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.0972919492051, "ttft_ms": 11.72175002284348, "decode_ms": 11.691333027556539}, "total_wall_ms": 11848.329706932418, "ttft_ms": 11.72175002284348, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6686 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad152b0fbec499eb226af5ba", "attempt_id": "d80390d54ed3", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.377257Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 467, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.96912501379848, "ttft_ms": 11.843541986308992, "decode_ms": 11.839832994155586}, "total_wall_ms": 11849.508290062658, "ttft_ms": 11.843541986308992, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6687 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea7dfe800281f7663543ee0e", "attempt_id": "e222ce7868c4", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.602842Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 460, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 186.07433408033103, "ttft_ms": 11.826290981844068, "decode_ms": 82.48495811130852}, "total_wall_ms": 11920.229956973344, "ttft_ms": 11.826290981844068, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 6688 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "949a8dab89a6758d64b67831", "attempt_id": "58d5af2be7cb", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.898871Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.84016605746, "ttft_ms": 11.794457910582423, "decode_ms": 11.997958994470537}, "total_wall_ms": 11849.45574903395, "ttft_ms": 11.794457910582423, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6689 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc008dc614648e16e1588613", "attempt_id": "92f96266df72", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:10.124159Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 461, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.82870799582452, "ttft_ms": 11.764083988964558, "decode_ms": 11.943458928726614}, "total_wall_ms": 11849.347415962256, "ttft_ms": 11.764083988964558, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6690 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16af9a53046028a4496ab413", "attempt_id": "28f6de5fcc12", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:10.349260Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.67920906934887, "ttft_ms": 12.047957978211343, "decode_ms": 11.850040988065302}, "total_wall_ms": 11849.513498949818, "ttft_ms": 12.047957978211343, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6691 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0e665ad4e80089ed6441be87", "attempt_id": "52c4c4ea9cc7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:19.994474Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 164.56274990923703, "ttft_ms": 11.853333096951246, "decode_ms": 117.99962492659688}, "total_wall_ms": 21351.748873945326, "ttft_ms": 11.853333096951246, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | ||||
| 6692 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2df70b38d477858500554113", "attempt_id": "57411c6174b6", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:20.305605Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 184.66441705822945, "ttft_ms": 12.011292041279376, "decode_ms": 129.9014170654118}, "total_wall_ms": 21383.978081983514, "ttft_ms": 12.011292041279376, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 6693 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0687e8c45124b05171238763", "attempt_id": "80743994c668", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:20.648131Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.12658297549933, "ttft_ms": 11.88695803284645, "decode_ms": 11.830750037916005}, "total_wall_ms": 21266.123705892824, "ttft_ms": 11.88695803284645, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6694 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a6271a37f0050d5fc481cbf1", "attempt_id": "3cfcf48721b7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:20.872912Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 163.80154201760888, "ttft_ms": 11.907457956112921, "decode_ms": 11.8259999435395}, "total_wall_ms": 21244.801664957777, "ttft_ms": 11.907457956112921, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6695 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "43e8188e6fcbbaa714559065", "attempt_id": "5c0d580b8ef0", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.075420Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 184.74191706627607, "ttft_ms": 11.820500018075109, "decode_ms": 12.04025000333786}, "total_wall_ms": 21265.862830914557, "ttft_ms": 11.820500018075109, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6696 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9dc205e7109900d187a806d", "attempt_id": "cf0c96dcba30", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.299314Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 459, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.26295793708414, "ttft_ms": 12.03054201323539, "decode_ms": 12.195541989058256}, "total_wall_ms": 21266.860874020495, "ttft_ms": 12.03054201323539, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6697 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3ab9372f4939a85724fe460d", "attempt_id": "735ed43fda60", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.524660Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 164.92141596972942, "ttft_ms": 11.728417011909187, "decode_ms": 11.774874990805984}, "total_wall_ms": 21245.71341497358, "ttft_ms": 11.728417011909187, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6698 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5e3e1f4699c2e1eba0af4a2", "attempt_id": "de9c015cf9e1", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.729308Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 184.78320795111358, "ttft_ms": 11.876291944645345, "decode_ms": 11.811333009973168}, "total_wall_ms": 21265.739165013656, "ttft_ms": 11.876291944645345, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6699 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fc2f863d93ab99742e6425c2", "attempt_id": "c82ad5dcf1f1", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.952962Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.4307500179857, "ttft_ms": 12.07654201425612, "decode_ms": 11.884083040058613}, "total_wall_ms": 21266.66474796366, "ttft_ms": 12.07654201425612, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6700 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1baa789d177e91815ae7c290", "attempt_id": "4977b3e56415", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.177851Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.31995895318687, "ttft_ms": 11.825166991911829, "decode_ms": 11.875541997142136}, "total_wall_ms": 21266.290581901558, "ttft_ms": 11.825166991911829, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6701 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6880837c1ad977807c81a8c7", "attempt_id": "795d5a0d3d3c", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.402353Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 467, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.88358291890472, "ttft_ms": 11.947875027544796, "decode_ms": 11.9317090138793}, "total_wall_ms": 21267.132830922492, "ttft_ms": 11.947875027544796, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6702 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2901c2cc1c8400aed5c10162", "attempt_id": "7434807679c6", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.627525Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 460, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.49416703172028, "ttft_ms": 11.954375077039003, "decode_ms": 82.17991702258587}, "total_wall_ms": 21336.92470600363, "ttft_ms": 11.954375077039003, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 6703 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3aa487a1dd3a5c87a1d77098", "attempt_id": "3db19c9fbe5b", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.923126Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.62016694340855, "ttft_ms": 11.85858401004225, "decode_ms": 11.833833996206522}, "total_wall_ms": 21266.592290019616, "ttft_ms": 11.85858401004225, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6704 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4442e52b34025e6a191afe2f", "attempt_id": "e81310278a02", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:23.148148Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 461, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.344333993271, "ttft_ms": 11.912125046364963, "decode_ms": 11.801417102105916}, "total_wall_ms": 21266.318249050528, "ttft_ms": 11.912125046364963, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6705 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9f045d2e63d93e8d6a99d2f", "attempt_id": "b4a5e56399cf", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:23.372326Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.00958301592618, "ttft_ms": 12.10662501398474, "decode_ms": 11.93462498486042}, "total_wall_ms": 21266.433289973065, "ttft_ms": 12.10662501398474, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6706 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8fc64bc3cad06c9588215dad", "attempt_id": "5e8695b9cc3d", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:42.448490Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 164.31158292107284, "ttft_ms": 11.830041999928653, "decode_ms": 118.30420908518136}, "total_wall_ms": 40198.22749809828, "ttft_ms": 11.830041999928653, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | ||||
| 6707 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ca4383ae11ed99ab4be24fd", "attempt_id": "9f3af4dbc6ca", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:42.759966Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.30508305411786, "ttft_ms": 11.870500049553812, "decode_ms": 11.98899990413338}, "total_wall_ms": 40112.903831060976, "ttft_ms": 11.870500049553812, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6708 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d9af521fe603265dcd61405b", "attempt_id": "a4e31c2666a5", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:42.985024Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.3665839880705, "ttft_ms": 11.911417008377612, "decode_ms": 12.037124950438738}, "total_wall_ms": 40113.028290099464, "ttft_ms": 11.911417008377612, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6709 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d644cd219138f195496a6d51", "attempt_id": "8366d6394f45", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.210258Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 164.26441702060401, "ttft_ms": 11.79575000423938, "decode_ms": 11.690332903526723}, "total_wall_ms": 40091.45541500766, "ttft_ms": 11.79575000423938, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6710 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "967619c4f4f2ca8f1dcd00f8", "attempt_id": "d11cd46bc111", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.413397Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.41454209480435, "ttft_ms": 11.846874956972897, "decode_ms": 11.894208961166441}, "total_wall_ms": 40112.84574808087, "ttft_ms": 11.846874956972897, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6711 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5831b593dd59b0101bd7e0ba", "attempt_id": "1466ef0c5242", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.638039Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 459, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.5804999358952, "ttft_ms": 11.820833082310855, "decode_ms": 11.707291007041931}, "total_wall_ms": 40112.84791503567, "ttft_ms": 11.820833082310855, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6712 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "997ad129bc8fd46175b9fbb6", "attempt_id": "b60ff342f297", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.863054Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 163.71025005355477, "ttft_ms": 12.047083000652492, "decode_ms": 11.986915953457355}, "total_wall_ms": 40091.58279001713, "ttft_ms": 12.047083000652492, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6713 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc715339cd3a5b092ab0917c", "attempt_id": "132a9cf5c14a", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.066533Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 184.9652089877054, "ttft_ms": 11.876665987074375, "decode_ms": 11.847666930407286}, "total_wall_ms": 40112.41283197887, "ttft_ms": 11.876665987074375, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6714 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "289389570fdead364afe57cd", "attempt_id": "8215859f24aa", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.291414Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 186.13395793363452, "ttft_ms": 11.890332913026214, "decode_ms": 11.867624940350652}, "total_wall_ms": 40113.636623020284, "ttft_ms": 11.890332913026214, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6715 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1a75f72cbdf1789e1a4b0bea", "attempt_id": "7918716ca426", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.516912Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.54324994329363, "ttft_ms": 11.868958012200892, "decode_ms": 11.753374943509698}, "total_wall_ms": 40112.881915061735, "ttft_ms": 11.868958012200892, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6716 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7b3c24aefef39fcd15ed4f6b", "attempt_id": "5a8d1c87703f", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.741923Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 467, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.2469160221517, "ttft_ms": 11.851832969114184, "decode_ms": 11.884917039424181}, "total_wall_ms": 40112.6968319295, "ttft_ms": 11.851832969114184, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6717 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c1ef69fa9d14f6018e17a8a5", "attempt_id": "d62e988f09e2", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.966402Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 460, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.5697090504691, "ttft_ms": 11.85687503311783, "decode_ms": 82.77320803608745}, "total_wall_ms": 40183.931623003446, "ttft_ms": 11.85687503311783, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 6718 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8e993e2b93f3d7d252e07ac7", "attempt_id": "9af155bbb6c5", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:45.262135Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.13104098383337, "ttft_ms": 11.781290988437831, "decode_ms": 11.864875094033778}, "total_wall_ms": 40112.47958091553, "ttft_ms": 11.781290988437831, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6719 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9802cdde1eaf14dab20233b", "attempt_id": "307bd52ae976", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:45.486687Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 461, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.66183291841298, "ttft_ms": 11.656958027742803, "decode_ms": 11.801082990132272}, "total_wall_ms": 40112.91949788574, "ttft_ms": 11.656958027742803, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6720 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "852f08d7cdd2d42c1f2c6935", "attempt_id": "e9a0318599ce", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:45.711271Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.55879197083414, "ttft_ms": 12.172917020507157, "decode_ms": 11.823417036794126}, "total_wall_ms": 40113.387331948616, "ttft_ms": 12.172917020507157, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6721 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "68f50df0be63c2da43fbe79a", "attempt_id": "4db60b8ac599", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:52.884291Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.1524170646444, "ttft_ms": 11.938499985262752, "decode_ms": 11.892291018739343}, "total_wall_ms": 7196.284751058556, "ttft_ms": 11.938499985262752, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6722 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e11e0d2619d789e65d5058f3", "attempt_id": "6cfd25bdbfc0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:53.152589Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.1518340567127, "ttft_ms": 11.90512499306351, "decode_ms": 11.911417008377612}, "total_wall_ms": 7196.398084051907, "ttft_ms": 11.90512499306351, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6723 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fae165009be3b7cb6f9d6d32", "attempt_id": "219d24d19ec8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:53.420308Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.42758295498788, "ttft_ms": 11.96104206610471, "decode_ms": 83.00912496633828}, "total_wall_ms": 7267.676292103715, "ttft_ms": 11.96104206610471, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6724 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02dc215c8204ba577fbbea51", "attempt_id": "857f65976221", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:53.759086Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 226.56595904845744, "ttft_ms": 12.16012507211417, "decode_ms": 11.987749952822924}, "total_wall_ms": 7196.175834047608, "ttft_ms": 12.16012507211417, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6725 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8c511232ddd04769672c226c", "attempt_id": "68804eda82b6", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.026161Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.2182919550687, "ttft_ms": 11.998250032775104, "decode_ms": 106.68470803648233}, "total_wall_ms": 7291.227417066693, "ttft_ms": 11.998250032775104, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 6726 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "00ac6ff047f1da2dba0f40f9", "attempt_id": "c52537b35467", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.388737Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.1752500673756, "ttft_ms": 12.066584080457687, "decode_ms": 12.00175005942583}, "total_wall_ms": 7196.650042082183, "ttft_ms": 12.066584080457687, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6727 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "39c502bfca2daed29daa04dc", "attempt_id": "7506e57ceb8b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.657417Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.0451249787584, "ttft_ms": 11.883500032126904, "decode_ms": 11.969916056841612}, "total_wall_ms": 7196.165043045767, "ttft_ms": 11.883500032126904, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6728 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "406514a3b1fcdf8c764b2cf5", "attempt_id": "e203d9c2cdda", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.925033Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.03204106073827, "ttft_ms": 11.973832966759801, "decode_ms": 11.963958968408406}, "total_wall_ms": 7196.251251152717, "ttft_ms": 11.973832966759801, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6729 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "34866c010d028255202e6678", "attempt_id": "1be1746ce157", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.192486Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 229.4199160533026, "ttft_ms": 11.845832923427224, "decode_ms": 11.970583000220358}, "total_wall_ms": 7198.51283414755, "ttft_ms": 11.845832923427224, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6730 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "385e7e889a365c58210ad056", "attempt_id": "2f0b0c70941d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.461693Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.41287492681295, "ttft_ms": 11.94062503054738, "decode_ms": 11.902958038263023}, "total_wall_ms": 7196.541083976626, "ttft_ms": 11.94062503054738, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6731 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "babe670b47b3449042e1dba4", "attempt_id": "c0a4dd05c363", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.728948Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 229.5377500122413, "ttft_ms": 11.927249957807362, "decode_ms": 12.015708023682237}, "total_wall_ms": 7198.722709086724, "ttft_ms": 11.927249957807362, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6732 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0dafcf322c7b111ebba73e59", "attempt_id": "9c044929c5b6", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.998335Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.59179095737636, "ttft_ms": 11.944000027142465, "decode_ms": 83.36770895402879}, "total_wall_ms": 7268.157125101425, "ttft_ms": 11.944000027142465, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 6733 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ce601a2052216f87b89273b", "attempt_id": "359803814e4a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:56.336875Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.23837499506772, "ttft_ms": 12.079291976988316, "decode_ms": 11.961207957938313}, "total_wall_ms": 7196.67954207398, "ttft_ms": 12.079291976988316, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6734 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71d9edf8102fdd8fa05fdfb0", "attempt_id": "dcfff703ac93", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:56.604501Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.17162501066923, "ttft_ms": 11.984833050519228, "decode_ms": 11.980416951701045}, "total_wall_ms": 7196.417959057726, "ttft_ms": 11.984833050519228, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6735 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e80711c1c4b49dbcdf9a792", "attempt_id": "4a51d726041c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:56.871886Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 226.47537500597537, "ttft_ms": 12.374832993373275, "decode_ms": 12.116165948100388}, "total_wall_ms": 7196.464334032498, "ttft_ms": 12.374832993373275, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6736 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b4f324d6da35d9081f7dd04a", "attempt_id": "02572e4cbbc2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:02.701137Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 559, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.97016700170934, "ttft_ms": 11.616958072409034, "decode_ms": 80.87270800024271}, "total_wall_ms": 12810.002376092598, "ttft_ms": 11.616958072409034, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-24D-4130", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "ef4c922649b61c51f72c7c8c9d9c9941a9d5c51879072478dde9d6a044f0fdc5"} | ||||
| 6737 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49bbf7e6cd5b317d2dee3c10", "attempt_id": "6f549b7c583f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.022454Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 564, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.2890829341486, "ttft_ms": 11.661082971841097, "decode_ms": 11.755208019167185}, "total_wall_ms": 12741.194042144343, "ttft_ms": 11.661082971841097, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6738 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "97c4b9a4cae7feb9f4d996f6", "attempt_id": "99544a096fd0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.274132Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 564, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.0874579520896, "ttft_ms": 11.825416004285216, "decode_ms": 46.2122909957543}, "total_wall_ms": 12774.739751126617, "ttft_ms": 11.825416004285216, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6739 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5487615749e711fcdc3eb6bf", "attempt_id": "04d459727032", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.559092Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 559, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.9234170531854, "ttft_ms": 11.812791926786304, "decode_ms": 11.560500017367303}, "total_wall_ms": 12740.752417128533, "ttft_ms": 11.812791926786304, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6740 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b26fe7c0df9a4efff0c4c74", "attempt_id": "2d7916462ea4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.810604Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 566, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.04395906534046, "ttft_ms": 11.588540975935757, "decode_ms": 57.86379100754857}, "total_wall_ms": 12786.96691710502, "ttft_ms": 11.588540975935757, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 6741 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8b9c028b74ba3f70ca5b894", "attempt_id": "5ce45c38bf17", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.108005Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 568, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.4286670004949, "ttft_ms": 11.623249971307814, "decode_ms": 11.489375028759241}, "total_wall_ms": 12740.999334026128, "ttft_ms": 11.623249971307814, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6742 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "32dc7df69e7d376f96bb6054", "attempt_id": "e4411a4ecf69", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.359303Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 559, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.47954103071243, "ttft_ms": 11.694958084262908, "decode_ms": 23.376333992928267}, "total_wall_ms": 12752.191834151745, "ttft_ms": 11.694958084262908, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6743 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f9d7762f9ac9b03675c3120e", "attempt_id": "7e3fe8f8181f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.621781Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 560, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.97699999902397, "ttft_ms": 11.56116696074605, "decode_ms": 23.316249949857593}, "total_wall_ms": 12752.484542084858, "ttft_ms": 11.56116696074605, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6744 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "649f4a52bd99f4b73bf23100", "attempt_id": "70692f9e60e7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.885108Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 576, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.21516700461507, "ttft_ms": 12.015625019557774, "decode_ms": 11.65220804978162}, "total_wall_ms": 12741.531834122725, "ttft_ms": 12.015625019557774, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6745 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b43245129a659e905753ecfc", "attempt_id": "1916b8d91973", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.137704Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 567, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.25241606589407, "ttft_ms": 11.684166034683585, "decode_ms": 11.535666999407113}, "total_wall_ms": 12740.972751169465, "ttft_ms": 11.684166034683585, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 6746 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1527f0659f51f503c5cfa7c9", "attempt_id": "cd2354957210", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.389510Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 576, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.76787505485117, "ttft_ms": 11.658875038847327, "decode_ms": 11.655832990072668}, "total_wall_ms": 12741.532542160712, "ttft_ms": 11.658875038847327, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6747 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f82a48787694dc7a1a39bd4f", "attempt_id": "120e47cec02b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.641281Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 571, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.16933405958116, "ttft_ms": 11.637625051662326, "decode_ms": 57.92537494562566}, "total_wall_ms": 12787.278209114447, "ttft_ms": 11.637625051662326, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,085,310", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "759234a32a22ec346567fe3fddc1cee453d2284580e2c63d21796dc4d97af3f0"} | ||||
| 6748 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0e7ed76be5dda33f02ba3dc8", "attempt_id": "c748e3d56eef", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.938877Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 567, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.69579098932445, "ttft_ms": 11.639332980848849, "decode_ms": 11.567125096917152}, "total_wall_ms": 12740.377584123053, "ttft_ms": 11.639332980848849, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6749 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90473dad2993e92aed0169de", "attempt_id": "b486bb8cc8e5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:06.189964Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 571, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.50716701615602, "ttft_ms": 11.632375069893897, "decode_ms": 11.580291902646422}, "total_wall_ms": 12741.362876142375, "ttft_ms": 11.632375069893897, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6750 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80b9cd275f630db236ee1cd0", "attempt_id": "d5757000dff5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:06.441617Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 573, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.03270799014717, "ttft_ms": 11.574291973374784, "decode_ms": 11.784041998907924}, "total_wall_ms": 12740.904167061672, "ttft_ms": 11.574291973374784, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6751 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d2cf26d2ac7fdf55d6d09cc2", "attempt_id": "e9d255dcf895", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.110008Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.95479193516076, "ttft_ms": 11.591459042392671, "decode_ms": 11.725915945135057}, "total_wall_ms": 24152.113250107504, "ttft_ms": 11.591459042392671, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6752 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c50016ca784113b8411cd237", "attempt_id": "a88fe76f2f5f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.359935Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.8256249446422, "ttft_ms": 11.622958001680672, "decode_ms": 11.49333396460861}, "total_wall_ms": 24151.864167070016, "ttft_ms": 11.622958001680672, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6753 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e0ca350d858a89d79fd390fe", "attempt_id": "8720f9b8db35", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.609003Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.50975001323968, "ttft_ms": 11.60995801910758, "decode_ms": 46.00933298934251}, "total_wall_ms": 24185.910208150744, "ttft_ms": 11.60995801910758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6754 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eaf153d40e5dd83ab2253030", "attempt_id": "38b1d9b250ce", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.892280Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.6272500930354, "ttft_ms": 11.58116606529802, "decode_ms": 11.570165981538594}, "total_wall_ms": 24151.551791117527, "ttft_ms": 11.58116606529802, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6755 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4395b20aed0c24c72eb49f25", "attempt_id": "70a5f9836700", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.140476Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 521, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.93962499778718, "ttft_ms": 11.500249966047704, "decode_ms": 57.71816708147526}, "total_wall_ms": 24198.06879211683, "ttft_ms": 11.500249966047704, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 6756 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0156396c92732a83f57119da", "attempt_id": "7f2b29fe2eae", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.435268Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 523, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.1938750129193, "ttft_ms": 11.526582995429635, "decode_ms": 11.78062497638166}, "total_wall_ms": 24152.32833311893, "ttft_ms": 11.526582995429635, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6757 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d48a71040ca2b766ec3dfcf3", "attempt_id": "0b2aba828063", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.684908Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.58245801739395, "ttft_ms": 11.653708992525935, "decode_ms": 22.99008402042091}, "total_wall_ms": 24162.9817080684, "ttft_ms": 11.653708992525935, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6758 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9bc382494a3a0be370a1b8e", "attempt_id": "7d777366268d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.944599Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 515, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.60525004193187, "ttft_ms": 11.536874924786389, "decode_ms": 23.005667026154697}, "total_wall_ms": 24162.907750112936, "ttft_ms": 11.536874924786389, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6759 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "43091c788a0fb7c5874a16cc", "attempt_id": "771c5dc51338", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.204158Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.17629199195653, "ttft_ms": 11.611875030212104, "decode_ms": 11.541125015355647}, "total_wall_ms": 24152.276833192445, "ttft_ms": 11.611875030212104, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6760 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7cab3c73da43ba26f7bcfb93", "attempt_id": "4ceefbea26ee", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.452913Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.83304106630385, "ttft_ms": 11.75800000783056, "decode_ms": 11.580749996937811}, "total_wall_ms": 24152.088042115793, "ttft_ms": 11.75800000783056, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6761 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "162b350a6b5fb319bd25108c", "attempt_id": "3940956f32a5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.703231Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.2346250321716, "ttft_ms": 11.699000024236739, "decode_ms": 11.551374918781221}, "total_wall_ms": 24152.424250147305, "ttft_ms": 11.699000024236739, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6762 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1eb5af42cd4bff7c0fe3db72", "attempt_id": "f038a2d9d3ba", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.952821Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.15895798336715, "ttft_ms": 11.71933300793171, "decode_ms": 57.41829099133611}, "total_wall_ms": 24198.201042134315, "ttft_ms": 11.71933300793171, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,120,310", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "c4e2d208e7fb67c45a0af9f9a6d4964665fdcf54126bdc7d4d62a5c42e59adf2"} | ||||
| 6763 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a5d26c83ba82f55989600b2c", "attempt_id": "4c9b6e48be4d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:21.248874Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.70904105342925, "ttft_ms": 11.660916963592172, "decode_ms": 11.569375055842102}, "total_wall_ms": 24151.899458141997, "ttft_ms": 11.660916963592172, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6764 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d203749cb9f3ead5f700a8fb", "attempt_id": "3bbb9b694eb9", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:21.498526Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.973624907434, "ttft_ms": 11.686792015098035, "decode_ms": 11.549124959856272}, "total_wall_ms": 24152.119250036776, "ttft_ms": 11.686792015098035, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6765 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50b01c048336574be4196ea1", "attempt_id": "c063cd9223f8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:21.748984Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 528, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.39549994748086, "ttft_ms": 11.564792017452419, "decode_ms": 11.556208948604763}, "total_wall_ms": 24152.326250099577, "ttft_ms": 11.564792017452419, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6766 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a53eb29c116facf1120564f", "attempt_id": "2318f6be076a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:43.733317Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.4774170545861, "ttft_ms": 11.706708930432796, "decode_ms": 11.513833072967827}, "total_wall_ms": 45879.62020805571, "ttft_ms": 11.706708930432796, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6767 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d19a9e872122659e4354d6b1", "attempt_id": "0fa981dd2b36", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:43.982805Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.87370796501637, "ttft_ms": 11.523750028572977, "decode_ms": 11.485249968245625}, "total_wall_ms": 45879.67462395318, "ttft_ms": 11.523750028572977, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6768 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4a042778f42cc7d5dcc8b8b5", "attempt_id": "e632c4b929b4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:44.231979Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.03379102330655, "ttft_ms": 11.518332990817726, "decode_ms": 45.96875002607703}, "total_wall_ms": 45914.309291983955, "ttft_ms": 11.518332990817726, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 6769 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "46afbea4c60193baf8eea7a5", "attempt_id": "319089f7e0f3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:44.515038Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.16345801763237, "ttft_ms": 11.467749951407313, "decode_ms": 11.508374940603971}, "total_wall_ms": 45879.936957964674, "ttft_ms": 11.467749951407313, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6770 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3312eb392bc296e3ac10ab47", "attempt_id": "d5f2e26ccdde", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:44.763625Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 521, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.93829099461436, "ttft_ms": 11.683167074806988, "decode_ms": 57.34379100613296}, "total_wall_ms": 45925.88841600809, "ttft_ms": 11.683167074806988, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 6771 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e256a24eea71bbf4a881837b", "attempt_id": "36f2f13fcba4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.058104Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 523, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.05954209249467, "ttft_ms": 11.571915936656296, "decode_ms": 11.591000016778708}, "total_wall_ms": 45880.02587505616, "ttft_ms": 11.571915936656296, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6772 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "75d7c208ecc0cbc1720dbeff", "attempt_id": "99ba0830220b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.307632Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 208.7915410520509, "ttft_ms": 11.58149994444102, "decode_ms": 23.20962504018098}, "total_wall_ms": 45890.458708046935, "ttft_ms": 11.58149994444102, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6773 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ae6ce946411a5c966c8886a", "attempt_id": "6283746f5e33", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.566820Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 515, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.80845799203962, "ttft_ms": 11.496959021314979, "decode_ms": 23.185333935543895}, "total_wall_ms": 45891.29208307713, "ttft_ms": 11.496959021314979, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 6774 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fb7a0f959b5b9d9b4c6eb180", "attempt_id": "f453d08aedb8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.826887Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.21349995862693, "ttft_ms": 11.583082959987223, "decode_ms": 11.523167020641267}, "total_wall_ms": 45880.12187497225, "ttft_ms": 11.583082959987223, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6775 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a3e75e7ff0bdb49ad0e315c", "attempt_id": "d27eb5a714b2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.075907Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.37204209621996, "ttft_ms": 11.538374936208129, "decode_ms": 11.743542039766908}, "total_wall_ms": 45879.43687499501, "ttft_ms": 11.538374936208129, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6776 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "369505830f6d0af79312068e", "attempt_id": "190ce7eef685", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.323965Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.2324590086937, "ttft_ms": 11.696124915033579, "decode_ms": 11.458582943305373}, "total_wall_ms": 45880.2797079552, "ttft_ms": 11.696124915033579, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6777 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2a987097d1761c6472c2cf5b", "attempt_id": "fc19e8c1e03b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.572734Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.68958304729313, "ttft_ms": 11.5634590620175, "decode_ms": 57.24787502549589}, "total_wall_ms": 45925.434957956895, "ttft_ms": 11.5634590620175, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,190,269", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "21023e2c5262695db33c4b4dfbf2ce40c8795742ceadf13db29509b3a088ad29"} | ||||
| 6778 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef14f9fff8fa5f6f50021e7a", "attempt_id": "d425bcc14047", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.867226Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.1102079031989, "ttft_ms": 11.63962495047599, "decode_ms": 11.495582992210984}, "total_wall_ms": 45880.12345810421, "ttft_ms": 11.63962495047599, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6779 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "18cbbe38a8da5c961b6bd6a7", "attempt_id": "4e99f3b95af7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:47.117226Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.20649990532547, "ttft_ms": 11.656583985313773, "decode_ms": 11.594834038987756}, "total_wall_ms": 45880.25770802051, "ttft_ms": 11.656583985313773, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6780 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5282996b8e943c58145fdb3b", "attempt_id": "d438d80378fa", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:47.366819Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 528, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.3344580391422, "ttft_ms": 11.54904195573181, "decode_ms": 11.54974999371916}, "total_wall_ms": 45880.225665983744, "ttft_ms": 11.54904195573181, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6781 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ea68c21988e6c3e307fe98a", "attempt_id": "61760789fca4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:54.560642Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.17279106099159, "ttft_ms": 11.82345801498741, "decode_ms": 11.827292037196457}, "total_wall_ms": 7130.719625158235, "ttft_ms": 11.82345801498741, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6782 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b50913f2e4efe90df7866026", "attempt_id": "82e4e40bbb30", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:54.765287Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.5389589248225, "ttft_ms": 11.915499926544726, "decode_ms": 129.21375001315027}, "total_wall_ms": 7248.639875091612, "ttft_ms": 11.915499926544726, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 6783 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "40ff4ba3875193852fcc2869", "attempt_id": "e84b4dbfc5db", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.087199Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.58516696002334, "ttft_ms": 11.787749943323433, "decode_ms": 11.765792034566402}, "total_wall_ms": 7131.01237511728, "ttft_ms": 11.787749943323433, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6784 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cdf26439619bebeaab3e4c6e", "attempt_id": "54c0db6df4e6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.291190Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.17929204180837, "ttft_ms": 12.010416015982628, "decode_ms": 11.781290988437831}, "total_wall_ms": 7130.971959093586, "ttft_ms": 12.010416015982628, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6785 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "23b9f866e5e5c1b8cbc29935", "attempt_id": "359d82465c6e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.495093Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 165.33824999351054, "ttft_ms": 11.931874905712903, "decode_ms": 11.804083944298327}, "total_wall_ms": 7132.061625015922, "ttft_ms": 11.931874905712903, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6786 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1930788d821a20e147f1ef40", "attempt_id": "5beaf27ef6dc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.701211Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.3592919651419, "ttft_ms": 11.888915905728936, "decode_ms": 11.97108393535018}, "total_wall_ms": 7152.126542059705, "ttft_ms": 11.888915905728936, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6787 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0c0133b9c689e9d857481420", "attempt_id": "fb008591de2f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.926782Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 439, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.45625002961606, "ttft_ms": 11.807958013378084, "decode_ms": 11.83654204942286}, "total_wall_ms": 7130.97204209771, "ttft_ms": 11.807958013378084, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6788 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "54df357d5a8f2d4e93433bfa", "attempt_id": "4bcd26fae1b5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.130611Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 441, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.52458291314542, "ttft_ms": 11.794665944762528, "decode_ms": 11.808041017502546}, "total_wall_ms": 7130.982834030874, "ttft_ms": 11.794665944762528, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6789 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d70de1e7a817eb1353daa2a", "attempt_id": "832f12926bc9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.334131Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.8098329976201, "ttft_ms": 11.822375003248453, "decode_ms": 11.8561249691993}, "total_wall_ms": 7152.3516670567915, "ttft_ms": 11.822375003248453, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6790 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e362aa75542bd746776f0c73", "attempt_id": "410b5f7e4587", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.558788Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 165.33612494822592, "ttft_ms": 11.832375079393387, "decode_ms": 82.35804201103747}, "total_wall_ms": 7202.369041973725, "ttft_ms": 11.832375079393387, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9134435", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "f7384892cb4f9a38f6115f91da5fec3f0d7e24e47877737b0f34e2b4a6af7d5a"} | ||||
| 6791 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c98d98199120f34f8827f16d", "attempt_id": "d490e7b827d5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.833980Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.3366669965908, "ttft_ms": 12.078124913387, "decode_ms": 11.815457954071462}, "total_wall_ms": 7152.1960840327665, "ttft_ms": 12.078124913387, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6792 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f1663034de9f6aba686ce64", "attempt_id": "2e1ae2e964a8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.059192Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.3935410035774, "ttft_ms": 11.88008300960064, "decode_ms": 82.08512503188103}, "total_wall_ms": 7222.34874998685, "ttft_ms": 11.88008300960064, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 6793 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "04c8079f8fa3824a466c287a", "attempt_id": "d5cbd328b5ff", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.354591Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.56816694699228, "ttft_ms": 12.100499938242137, "decode_ms": 11.922874953597784}, "total_wall_ms": 7131.640583975241, "ttft_ms": 12.100499938242137, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6794 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "417e157d94e0e3154c9c7cd6", "attempt_id": "bd2ab830ed00", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.559883Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 452, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.2195409592241, "ttft_ms": 12.060333974659443, "decode_ms": 11.880666948854923}, "total_wall_ms": 7152.249751030467, "ttft_ms": 12.060333974659443, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6795 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b840b5a8a2bea799e19e3f8f", "attempt_id": "9a3f0b9d305d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.786959Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.63199997879565, "ttft_ms": 11.94083399605006, "decode_ms": 11.851874995045364}, "total_wall_ms": 7152.419749996625, "ttft_ms": 11.94083399605006, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6796 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3765388b04f031b28489e005", "attempt_id": "a71aa6b7eb29", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:01.971893Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.02712496370077, "ttft_ms": 11.487290961667895, "decode_ms": 11.496416991576552}, "total_wall_ms": 11106.89208295662, "ttft_ms": 11.487290961667895, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6797 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02167f383d66e8cf77d7fdb9", "attempt_id": "3d5e86716d1f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.194376Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.27483301982284, "ttft_ms": 11.460541049018502, "decode_ms": 11.465542018413544}, "total_wall_ms": 11107.04320797231, "ttft_ms": 11.460541049018502, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6798 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f52f453ce41971920a155afc", "attempt_id": "1a4648b7f9c8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.416316Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 187.6737920101732, "ttft_ms": 11.563832988031209, "decode_ms": 11.674916953779757}, "total_wall_ms": 11111.748209106736, "ttft_ms": 11.563832988031209, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6799 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f94e6b903be994776c463660", "attempt_id": "a4e81ef944e2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.643020Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 181.05399992782623, "ttft_ms": 11.5665839985013, "decode_ms": 11.42991695087403}, "total_wall_ms": 11104.8718750244, "ttft_ms": 11.5665839985013, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6800 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2c82fa120f3bc17680c45643", "attempt_id": "a2dcd8d19210", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.862162Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 433, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 186.2979590659961, "ttft_ms": 11.589249945245683, "decode_ms": 11.464667040854692}, "total_wall_ms": 11110.232583014295, "ttft_ms": 11.589249945245683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6801 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b6911b723a0a6d66f439ed0", "attempt_id": "38f74865ed67", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.087265Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 435, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 188.05520795285702, "ttft_ms": 11.52770803309977, "decode_ms": 11.488832999020815}, "total_wall_ms": 11111.909626051784, "ttft_ms": 11.52770803309977, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6802 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "74408db948005691fd67cf2f", "attempt_id": "179a25fa3c47", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.314314Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 182.77116701938212, "ttft_ms": 11.77541702054441, "decode_ms": 11.436625034548342}, "total_wall_ms": 11106.801541987807, "ttft_ms": 11.77541702054441, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6803 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a46ba1327729fe935236eda5", "attempt_id": "1dded563a49c", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.535427Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 427, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.2695419434458, "ttft_ms": 11.47595897782594, "decode_ms": 11.704165954142809}, "total_wall_ms": 11107.27700102143, "ttft_ms": 11.47595897782594, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6804 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3110b0e89708c09b55470ecf", "attempt_id": "36a6c8ab9f4d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.757378Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 186.68641697149724, "ttft_ms": 11.72691595274955, "decode_ms": 11.568082962185144}, "total_wall_ms": 11110.898167011328, "ttft_ms": 11.72691595274955, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6805 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80771fd8fc01a8494cf3e917", "attempt_id": "865cf39c2408", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.982572Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 185.10508292820305, "ttft_ms": 11.534375022165477, "decode_ms": 11.476874933578074}, "total_wall_ms": 11108.943209052086, "ttft_ms": 11.534375022165477, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6806 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab9c0812bc1e5975c3077779", "attempt_id": "82966a7c33a8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.206904Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 184.13154198788106, "ttft_ms": 11.771833058446646, "decode_ms": 11.547999922186136}, "total_wall_ms": 11108.296750113368, "ttft_ms": 11.771833058446646, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6807 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2313839625baddfb110a28b1", "attempt_id": "9835423d86ce", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.429592Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.85466700419784, "ttft_ms": 11.49316702503711, "decode_ms": 57.294458034448326}, "total_wall_ms": 11153.48612505477, "ttft_ms": 11.49316702503711, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,066,734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "dc9cab51923d7bfcae06d683e0d005a1575296aa981b1594b358ff8e12cd8aa2"} | ||||
| 6808 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "34a7ad34fb6e6579a2a680ba", "attempt_id": "7db5b64893bb", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.697315Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 181.80583301000297, "ttft_ms": 11.380832991562784, "decode_ms": 11.359915952198207}, "total_wall_ms": 11105.435084085912, "ttft_ms": 11.380832991562784, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6809 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5cab9bb8fcc30736863eaa8a", "attempt_id": "adbce4bc2b9a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.917535Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.6892500286922, "ttft_ms": 11.75812492147088, "decode_ms": 11.59737491980195}, "total_wall_ms": 11108.054375974461, "ttft_ms": 11.75812492147088, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6810 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3af432d259e3bca11790a66c", "attempt_id": "0388347f07e1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:05.141625Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 440, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 184.25258295610547, "ttft_ms": 11.788749950937927, "decode_ms": 11.493749916553497}, "total_wall_ms": 11108.51729195565, "ttft_ms": 11.788749950937927, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6811 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6e3620e341e5f19190427c2a", "attempt_id": "c589a63df051", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.983520Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.1999579919502, "ttft_ms": 11.594541021622717, "decode_ms": 11.508165975101292}, "total_wall_ms": 19722.014916944318, "ttft_ms": 11.594541021622717, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6812 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "341398af21254299fd05432c", "attempt_id": "e87eb141ab39", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.207464Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 181.44158297218382, "ttft_ms": 11.374584049917758, "decode_ms": 11.39879203401506}, "total_wall_ms": 19718.946166918613, "ttft_ms": 11.374584049917758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6813 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ea130f623cb39142ed4abc7", "attempt_id": "426194313c55", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.427675Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 182.22395901102573, "ttft_ms": 11.67129201348871, "decode_ms": 11.588084045797586}, "total_wall_ms": 19720.284540904686, "ttft_ms": 11.67129201348871, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6814 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "483c4c81d9e0a199d7040350", "attempt_id": "fabb6e48b401", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.650090Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.7006249697879, "ttft_ms": 11.6478749550879, "decode_ms": 11.421707924455404}, "total_wall_ms": 19721.45666682627, "ttft_ms": 11.6478749550879, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6815 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ac08b5146a1444ed44eceed", "attempt_id": "739d48ad990f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.872852Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 433, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.29208302404732, "ttft_ms": 11.762207956053317, "decode_ms": 11.552499956451356}, "total_wall_ms": 19722.280749934725, "ttft_ms": 11.762207956053317, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6816 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5a0be8a9e3fcf17d9d150608", "attempt_id": "cdcb8c8c491c", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.096165Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 435, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.27404104638845, "ttft_ms": 11.543708038516343, "decode_ms": 11.734125087969005}, "total_wall_ms": 19721.227041911334, "ttft_ms": 11.543708038516343, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6817 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5f743a995d01fdf85b468378", "attempt_id": "e09d04d580e2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.318041Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 182.8124999301508, "ttft_ms": 11.591291055083275, "decode_ms": 11.483666021376848}, "total_wall_ms": 19720.546958851628, "ttft_ms": 11.591291055083275, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6818 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "927b79ffdb1963ca4e10d658", "attempt_id": "44aabd13aa1a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.539613Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 427, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.50520904641598, "ttft_ms": 11.576459044590592, "decode_ms": 11.547417030669749}, "total_wall_ms": 19721.285083913244, "ttft_ms": 11.576459044590592, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6819 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "57c7f9d0e47ccd7281b791a9", "attempt_id": "49e820a8cbe8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.760995Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 185.54966698866338, "ttft_ms": 11.717541958205402, "decode_ms": 11.486334027722478}, "total_wall_ms": 19723.56299997773, "ttft_ms": 11.717541958205402, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6820 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecad42e6593cb2bb3039820e", "attempt_id": "80eb3587ba88", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.984777Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.88687493279576, "ttft_ms": 11.714499909430742, "decode_ms": 11.591916088946164}, "total_wall_ms": 19721.97991691064, "ttft_ms": 11.714499909430742, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6821 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55580b0dd5cc4d278dd95af6", "attempt_id": "a2a15e8a51f4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.208789Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.63045796286315, "ttft_ms": 11.513874982483685, "decode_ms": 11.528540984727442}, "total_wall_ms": 19721.35595791042, "ttft_ms": 11.513874982483685, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6822 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8f08cbdd34b9bc51dbbee7b9", "attempt_id": "ee87677406ad", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.431465Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.42091590259224, "ttft_ms": 11.530417017638683, "decode_ms": 57.694667018949986}, "total_wall_ms": 19768.310999847017, "ttft_ms": 11.530417017638683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,066,734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "dc9cab51923d7bfcae06d683e0d005a1575296aa981b1594b358ff8e12cd8aa2"} | ||||
| 6823 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6a29544c45d697374848293b", "attempt_id": "6b5c885dec96", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.700159Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.90699992980808, "ttft_ms": 11.957417009398341, "decode_ms": 11.740165995433927}, "total_wall_ms": 19723.47149986308, "ttft_ms": 11.957417009398341, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6824 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "37b13692712397bfb9969bdd", "attempt_id": "4ee39ef4a927", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.924776Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 181.35991704184562, "ttft_ms": 11.548041016794741, "decode_ms": 11.508374940603971}, "total_wall_ms": 19719.093291903846, "ttft_ms": 11.548041016794741, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6825 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0c07d95ce1c0fdcfcc593ccb", "attempt_id": "15207700b686", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:17.146310Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 440, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.65470790397376, "ttft_ms": 11.542166932485998, "decode_ms": 11.513334000483155}, "total_wall_ms": 19722.375583834946, "ttft_ms": 11.542166932485998, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6826 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "39e2a6f143e6938c0c3db118", "attempt_id": "09f2a992287b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:34.649674Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.08550002984703, "ttft_ms": 11.601291946135461, "decode_ms": 11.484125046990812}, "total_wall_ms": 36996.3697087951, "ttft_ms": 11.601291946135461, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6827 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "899c3af9a862ddf9b1c9041f", "attempt_id": "50e48687a91f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:34.872670Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 182.90829204488546, "ttft_ms": 11.730083962902427, "decode_ms": 11.43295899964869}, "total_wall_ms": 36996.33025098592, "ttft_ms": 11.730083962902427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6828 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b2082f56337184cddfcab15", "attempt_id": "81493b7edde7", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.094787Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.24195801001042, "ttft_ms": 11.776624945923686, "decode_ms": 11.558542028069496}, "total_wall_ms": 36998.90954291914, "ttft_ms": 11.776624945923686, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6829 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bef343ba48fd744c7b5dbff5", "attempt_id": "1d8241ac7869", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.319566Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 184.03991602826864, "ttft_ms": 11.676999973133206, "decode_ms": 11.541791958734393}, "total_wall_ms": 36997.526583843865, "ttft_ms": 11.676999973133206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6830 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "443e892f11ce691c38d53866", "attempt_id": "0e754a5883fc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.544813Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 433, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.23162510246038, "ttft_ms": 11.700915987603366, "decode_ms": 11.60245796199888}, "total_wall_ms": 36998.68741782848, "ttft_ms": 11.700915987603366, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6831 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b9c8f02f284f8c808bf7cb73", "attempt_id": "85dee5f358ed", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.768737Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 435, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 184.88633399829268, "ttft_ms": 11.612833011895418, "decode_ms": 11.551167001016438}, "total_wall_ms": 36998.181041912176, "ttft_ms": 11.612833011895418, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6832 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "31988c7fcdb04eae184ef6e0", "attempt_id": "244405cfe9ab", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.992030Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.257416007109, "ttft_ms": 11.537457932718098, "decode_ms": 11.523457942530513}, "total_wall_ms": 36996.444708900526, "ttft_ms": 11.537457932718098, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6833 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dd4f984fd246a4b0a43721c4", "attempt_id": "ece20b68d2c4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.213603Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 427, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.06658300571144, "ttft_ms": 11.994833941571414, "decode_ms": 11.570833972655237}, "total_wall_ms": 36996.86645891052, "ttft_ms": 11.994833941571414, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 6834 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "820d76ff89aac2a575b498a1", "attempt_id": "2e04488afea4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.435516Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.62854199949652, "ttft_ms": 11.598541983403265, "decode_ms": 11.552541982382536}, "total_wall_ms": 36996.93225091323, "ttft_ms": 11.598541983403265, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6835 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b00e6a1b7f83f6c0def836b4", "attempt_id": "a54bd0e3c2f1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.658381Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.11045794002712, "ttft_ms": 11.474458035081625, "decode_ms": 11.570999980904162}, "total_wall_ms": 36998.308541835286, "ttft_ms": 11.474458035081625, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6836 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dfcd2d188fe0e7d04babc79c", "attempt_id": "0fffbdbf5ba7", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.882133Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.32691604923457, "ttft_ms": 11.628582957200706, "decode_ms": 11.593833100050688}, "total_wall_ms": 36998.779916903004, "ttft_ms": 11.628582957200706, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6837 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7675354915ddcee787617f38", "attempt_id": "addda394f4c3", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.105901Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.45025007147342, "ttft_ms": 11.538333958014846, "decode_ms": 57.53012502100319}, "total_wall_ms": 37042.65787592158, "ttft_ms": 11.538333958014846, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,066,734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "dc9cab51923d7bfcae06d683e0d005a1575296aa981b1594b358ff8e12cd8aa2"} | ||||
| 6838 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a4702798a9616e99b3f21f59", "attempt_id": "0a5ee6adbe1f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.374216Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 182.42191604804248, "ttft_ms": 11.514583951793611, "decode_ms": 11.424958007410169}, "total_wall_ms": 36995.47787592746, "ttft_ms": 11.514583951793611, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6839 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "63bb4d730073f8a8136a1dc0", "attempt_id": "957543e372b8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.595047Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 181.93808302748948, "ttft_ms": 12.016542023047805, "decode_ms": 11.811875039711595}, "total_wall_ms": 36996.139541850425, "ttft_ms": 12.016542023047805, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6840 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "225263431e070ab46a7e57fd", "attempt_id": "ce874528b8ff", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.816687Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 440, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.19450002349913, "ttft_ms": 11.919625103473663, "decode_ms": 11.719666887074709}, "total_wall_ms": 36999.187958892435, "ttft_ms": 11.919625103473663, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6841 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "66572425c7034fc4285d7b51", "attempt_id": "2e86bc484468", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:45.020626Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.18162497039884, "ttft_ms": 11.884292005561292, "decode_ms": 11.968541075475514}, "total_wall_ms": 7147.845167084597, "ttft_ms": 11.884292005561292, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6842 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a505875f1d4297785d2b1c75", "attempt_id": "0feb6491173b", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:45.288112Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.2848329739645, "ttft_ms": 11.879250057972968, "decode_ms": 143.36750004440546}, "total_wall_ms": 7279.33433407452, "ttft_ms": 11.879250057972968, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 6843 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2e82ba4be7c3551d233bae4a", "attempt_id": "fd9ec5061d83", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:45.686474Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.71499999705702, "ttft_ms": 12.005083030089736, "decode_ms": 83.47604202572256}, "total_wall_ms": 7219.073334126733, "ttft_ms": 12.005083030089736, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 6844 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2663feb6b3806e15db462141", "attempt_id": "4a68814f482c", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.024752Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.24654199555516, "ttft_ms": 11.966542107984424, "decode_ms": 107.16783395037055}, "total_wall_ms": 7243.166626081802, "ttft_ms": 11.966542107984424, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 6845 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1958547f71b8ddf37f656406", "attempt_id": "1a46ec016340", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.387524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.36379189882427, "ttft_ms": 12.000042013823986, "decode_ms": 11.930583976209164}, "total_wall_ms": 7148.120459052734, "ttft_ms": 12.000042013823986, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6846 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "902f6c62c96e48069f943197", "attempt_id": "b1ccca241cdd", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.654816Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.08666697144508, "ttft_ms": 11.93825004156679, "decode_ms": 11.94079197011888}, "total_wall_ms": 7147.7413760731, "ttft_ms": 11.93825004156679, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6847 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "576887d7bdeaf2bc4e7b4398", "attempt_id": "8dca5f79eb36", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.921605Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.9028329756111, "ttft_ms": 11.929624946787953, "decode_ms": 11.902374913915992}, "total_wall_ms": 7147.443876019679, "ttft_ms": 11.929624946787953, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6848 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "de4b312c2dede396a1a34597", "attempt_id": "1f8bac3b7bd1", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:47.187621Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.014834061265, "ttft_ms": 12.189500033855438, "decode_ms": 12.008458958007395}, "total_wall_ms": 7148.10291712638, "ttft_ms": 12.189500033855438, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6849 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "af04aeaebaa092508d102f44", "attempt_id": "36e81c844352", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:47.454980Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 229.73904199898243, "ttft_ms": 11.996667017228901, "decode_ms": 83.51000002585351}, "total_wall_ms": 7222.080167150125, "ttft_ms": 11.996667017228901, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 6850 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c0ee52d6b9cc2e3be3a2d06d", "attempt_id": "d2437f21e50a", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:47.796422Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.97950003203005, "ttft_ms": 11.93766703363508, "decode_ms": 107.30429191607982}, "total_wall_ms": 7242.995709064417, "ttft_ms": 11.93766703363508, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 6851 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59b9ff8b13d556d357c09d32", "attempt_id": "4dd5657b5038", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:48.158347Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 229.18437502812594, "ttft_ms": 11.881874990649521, "decode_ms": 83.33941700402647}, "total_wall_ms": 7221.206209156662, "ttft_ms": 11.881874990649521, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 6852 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e44219fd3fa6f41965c4458a", "attempt_id": "ad4dbca8b42d", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:48.498213Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.49158297665417, "ttft_ms": 11.954542016610503, "decode_ms": 119.40641701221466}, "total_wall_ms": 7255.645459052175, "ttft_ms": 11.954542016610503, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,077", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "2044d7c4afd32892ac22705680e35174db83308c139b02a1494275cc5e24aff3"} | ||||
| 6853 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "94e171be9d7fba83905b3a10", "attempt_id": "406fb3f0385a", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:48.873002Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.21345799416304, "ttft_ms": 12.138666934333742, "decode_ms": 11.895625037141144}, "total_wall_ms": 7147.149959113449, "ttft_ms": 12.138666934333742, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6854 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1bf57ae1ad924ff10170ec6c", "attempt_id": "a03914bdc8b1", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:49.139135Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.58466605935246, "ttft_ms": 12.026333017274737, "decode_ms": 11.8740409379825}, "total_wall_ms": 7147.256001015194, "ttft_ms": 12.026333017274737, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6855 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8903790c81721835f22e455b", "attempt_id": "753fac8761e6", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:49.405855Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.44899995066226, "ttft_ms": 12.065957998856902, "decode_ms": 12.056792038492858}, "total_wall_ms": 7147.501792060211, "ttft_ms": 12.065957998856902, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6856 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "380461c99b1dd78a93896e5a", "attempt_id": "183d164b05e1", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:56.046438Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.353875012137, "ttft_ms": 11.964041041210294, "decode_ms": 11.987666017375886}, "total_wall_ms": 13519.761501112953, "ttft_ms": 11.964041041210294, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6857 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bb672f0d17e1dce0f73b2bfe", "attempt_id": "bc487cb70976", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:56.313252Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.6314160078764, "ttft_ms": 11.946083046495914, "decode_ms": 142.85629207734019}, "total_wall_ms": 13650.942834210582, "ttft_ms": 11.946083046495914, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 6858 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2f42ac5d2c84d2ded643b7b8", "attempt_id": "1ff8956d4f1e", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:56.710422Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.8895839806646, "ttft_ms": 11.947875027544796, "decode_ms": 83.42229202389717}, "total_wall_ms": 13591.716709081084, "ttft_ms": 11.947875027544796, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 6859 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "96f79ccf45bf13aa8e20f958", "attempt_id": "207e91b6d37a", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.049391Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.73004202079028, "ttft_ms": 11.906833969987929, "decode_ms": 106.80929094087332}, "total_wall_ms": 13614.928168128245, "ttft_ms": 11.906833969987929, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 6860 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02be1f189f0e83e046ada8a0", "attempt_id": "67e0ed26a09d", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.410889Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.68625006917864, "ttft_ms": 12.129915994592011, "decode_ms": 11.946541024371982}, "total_wall_ms": 13520.36462619435, "ttft_ms": 12.129915994592011, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6861 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4f9b895e9fe6ba03ced05886", "attempt_id": "821443996dd8", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.678651Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.64520796388388, "ttft_ms": 12.175749987363815, "decode_ms": 12.064957991242409}, "total_wall_ms": 13520.53808409255, "ttft_ms": 12.175749987363815, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6862 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6b3ac448590ef7597cbad0e", "attempt_id": "98cb0c7a8ad5", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.946886Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.30995803046972, "ttft_ms": 12.314041960053146, "decode_ms": 12.070958036929369}, "total_wall_ms": 13520.389126148075, "ttft_ms": 12.314041960053146, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6863 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0d345796a81846aaa98c201c", "attempt_id": "46761864a207", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:58.215165Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.8997090868652, "ttft_ms": 12.095415964722633, "decode_ms": 11.946999933570623}, "total_wall_ms": 13520.565334125422, "ttft_ms": 12.095415964722633, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6864 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4bdf6b31732546e18ddc60f3", "attempt_id": "cd86d3586881", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:58.482109Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 229.23491708934307, "ttft_ms": 12.094041099771857, "decode_ms": 83.74658308457583}, "total_wall_ms": 13594.683792092837, "ttft_ms": 12.094041099771857, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 6865 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2856af02e43ff323d8c69a7b", "attempt_id": "74113a5e69fa", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:58.824450Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.23045805469155, "ttft_ms": 11.929041938856244, "decode_ms": 83.53291696403176}, "total_wall_ms": 13592.285459162667, "ttft_ms": 11.929041938856244, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 6866 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "541ad99c626c3a41b2c3175d", "attempt_id": "5659a2252616", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:59.163426Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 229.40008400473744, "ttft_ms": 11.954874964430928, "decode_ms": 83.58804101590067}, "total_wall_ms": 13594.433375168592, "ttft_ms": 11.954874964430928, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 6867 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6f096479c1c3767ecfd79af", "attempt_id": "bedd18d26377", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:59.504837Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.7585409572348, "ttft_ms": 11.888833018019795, "decode_ms": 107.57604101672769}, "total_wall_ms": 13615.696668159217, "ttft_ms": 11.888833018019795, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | ||||
| 6868 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03a625a270456957c9a5260d", "attempt_id": "d2753c6723dc", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:59.866982Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.17066702898592, "ttft_ms": 12.123832944780588, "decode_ms": 11.935041984543204}, "total_wall_ms": 13520.759376115166, "ttft_ms": 12.123832944780588, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6869 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "82286b4876452534535fc3f7", "attempt_id": "fc32f95bc122", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:00.134157Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.18558309134096, "ttft_ms": 11.929249973036349, "decode_ms": 11.930458946153522}, "total_wall_ms": 13520.495167118497, "ttft_ms": 11.929249973036349, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6870 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecb5609d72e2010bf8a46dd6", "attempt_id": "b3f114190f70", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:00.401203Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.34008298721164, "ttft_ms": 11.943458928726614, "decode_ms": 12.19241600483656}, "total_wall_ms": 13520.941001246683, "ttft_ms": 11.943458928726614, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6871 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ff1006e28b6f6c0c9566fe34", "attempt_id": "a51fca6b3e37", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:13.407941Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.7156249145046, "ttft_ms": 12.033959035761654, "decode_ms": 11.925957980565727}, "total_wall_ms": 26257.028710097075, "ttft_ms": 12.033959035761654, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6872 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0f34eb76b4cc9238155f6bda", "attempt_id": "53b937192b1b", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:13.675623Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.34779091458768, "ttft_ms": 12.206749990582466, "decode_ms": 142.62641698587686}, "total_wall_ms": 26387.52383517567, "ttft_ms": 12.206749990582466, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 6873 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d865c8871bae28443662716e", "attempt_id": "e05e91e03c9d", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:14.073210Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.63799999281764, "ttft_ms": 11.91820902749896, "decode_ms": 82.98595796804875}, "total_wall_ms": 26327.778584207408, "ttft_ms": 11.91820902749896, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 6874 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6816ded36c88edd66b898984", "attempt_id": "19c5a78e1d25", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:14.410499Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.96537501178682, "ttft_ms": 12.162000057287514, "decode_ms": 106.8377080373466}, "total_wall_ms": 26352.300918195397, "ttft_ms": 12.162000057287514, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 6875 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c301dd766530faf62455a168", "attempt_id": "81b901526295", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:14.772878Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.0164160290733, "ttft_ms": 12.081584078259766, "decode_ms": 11.892499984242022}, "total_wall_ms": 26257.335210219026, "ttft_ms": 12.081584078259766, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6876 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "515b9ba7e270b411ea70bebc", "attempt_id": "22dcd59bf4de", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.040142Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.2122090216726, "ttft_ms": 11.936416034586728, "decode_ms": 12.089541996829212}, "total_wall_ms": 26257.46879214421, "ttft_ms": 11.936416034586728, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6877 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d1511681c18cdabba4457282", "attempt_id": "034bd2cbc782", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.307282Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.56787501182407, "ttft_ms": 12.073084013536572, "decode_ms": 11.860958067700267}, "total_wall_ms": 26256.818293244578, "ttft_ms": 12.073084013536572, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6878 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2ec7fa37799fc68a66dde9e2", "attempt_id": "a4a75d106f20", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.573209Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.69395804405212, "ttft_ms": 11.937333038076758, "decode_ms": 11.821958003565669}, "total_wall_ms": 26256.68870913796, "ttft_ms": 11.937333038076758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6879 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d27ec1b890aacecdb5689e44", "attempt_id": "9e1a0fbc23ca", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.839519Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 228.81687502376735, "ttft_ms": 12.114583048969507, "decode_ms": 83.16391706466675}, "total_wall_ms": 26330.437876167707, "ttft_ms": 12.114583048969507, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 6880 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a44dbfe50a76668bb7d8098", "attempt_id": "25b5e424bc5e", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:16.179154Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.1562909008935, "ttft_ms": 11.805207934230566, "decode_ms": 82.96349993906915}, "total_wall_ms": 26328.26362620108, "ttft_ms": 11.805207934230566, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 6881 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ce4a8ce342fe2b4d9d75cef4", "attempt_id": "3145a04bf5b4", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:16.517038Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 229.53029198106378, "ttft_ms": 11.93220796994865, "decode_ms": 83.03158299531788}, "total_wall_ms": 26330.745167215355, "ttft_ms": 11.93220796994865, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 6882 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cf43bac325be2e3c6cdbe538", "attempt_id": "02116ce0e197", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:16.857399Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.23541699815542, "ttft_ms": 11.96366606745869, "decode_ms": 106.80866707116365}, "total_wall_ms": 26352.34383516945, "ttft_ms": 11.96366606745869, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | ||||
| 6883 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb444dc416a2807482ddba59", "attempt_id": "4bd944d4aad0", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:17.219825Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.01216698624194, "ttft_ms": 12.129625072702765, "decode_ms": 11.959999916143715}, "total_wall_ms": 26257.44529312942, "ttft_ms": 12.129625072702765, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6884 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9cd4e7c12cea665f50ab676a", "attempt_id": "6946650fb94e", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:17.487458Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.3828339530155, "ttft_ms": 12.002791976556182, "decode_ms": 11.87199994456023}, "total_wall_ms": 26257.582126068883, "ttft_ms": 12.002791976556182, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6885 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "91adf0fd87f698d5fc4ccc26", "attempt_id": "9ce3f9c45474", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:17.754665Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.2061250405386, "ttft_ms": 12.478624936193228, "decode_ms": 12.182833044789732}, "total_wall_ms": 26258.310334174894, "ttft_ms": 12.478624936193228, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6886 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "37df68d8055d79fbfd23563b", "attempt_id": "ca9e93fa7e21", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:43.427164Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.07891697064042, "ttft_ms": 11.851249961182475, "decode_ms": 11.946334037929773}, "total_wall_ms": 51657.05141820945, "ttft_ms": 11.851249961182475, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6887 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3fbb5dbcefb601f59b61329c", "attempt_id": "d116a2b33bc3", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:43.694527Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.05824999138713, "ttft_ms": 11.875666910782456, "decode_ms": 142.63566699810326}, "total_wall_ms": 51787.73366822861, "ttft_ms": 11.875666910782456, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 6888 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5cee5fdde1034c1da3597c7c", "attempt_id": "b6cadff16730", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:44.091872Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.16091701295227, "ttft_ms": 11.90966705325991, "decode_ms": 83.14320794306695}, "total_wall_ms": 51728.349834214896, "ttft_ms": 11.90966705325991, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 6889 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7258afe9605849d00393b6f2", "attempt_id": "29885195cd24", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:44.429461Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.08812507335097, "ttft_ms": 11.908416985534132, "decode_ms": 106.7351249512285}, "total_wall_ms": 51751.89341825899, "ttft_ms": 11.908416985534132, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 6890 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ed83324d3a81cb598bdfe59", "attempt_id": "17cdac03bc1e", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:44.790918Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.51779097598046, "ttft_ms": 11.86512503772974, "decode_ms": 11.907125008292496}, "total_wall_ms": 51657.44196018204, "ttft_ms": 11.86512503772974, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6891 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be09b3aa2cf0ce21e167c50f", "attempt_id": "5eda559b81c8", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.057736Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.63350000604987, "ttft_ms": 11.872583068907261, "decode_ms": 11.936583905480802}, "total_wall_ms": 51657.599751255475, "ttft_ms": 11.872583068907261, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6892 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1ff9d580e18b146759c5708a", "attempt_id": "808c256cbac4", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.324773Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 226.95679205935448, "ttft_ms": 11.836083023808897, "decode_ms": 11.92099996842444}, "total_wall_ms": 51656.8319182843, "ttft_ms": 11.836083023808897, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6893 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5f0340a743fad487b3bf3c62", "attempt_id": "2423134f87ea", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.590986Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.29758301284164, "ttft_ms": 11.906791012734175, "decode_ms": 11.86133292503655}, "total_wall_ms": 51657.20420924481, "ttft_ms": 11.906791012734175, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6894 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1cb6280d20f6891b6924da71", "attempt_id": "ab8085c940ca", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.857087Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 229.32608297560364, "ttft_ms": 11.926500010304153, "decode_ms": 82.94041699264199}, "total_wall_ms": 51730.34229315817, "ttft_ms": 11.926500010304153, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 6895 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b27be43fe49ed2b2f7c41115", "attempt_id": "dfd418fb5e0a", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.196742Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.38179203588516, "ttft_ms": 12.031542020849884, "decode_ms": 82.88679202087224}, "total_wall_ms": 51728.450918220915, "ttft_ms": 12.031542020849884, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 6896 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "57775a8b8c086ba5469d6edc", "attempt_id": "a7a503e3100a", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.534662Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 229.35337503440678, "ttft_ms": 11.958708055317402, "decode_ms": 83.04466598201543}, "total_wall_ms": 51730.515543255024, "ttft_ms": 11.958708055317402, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 6897 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "07f9e2f958596f66b857e98e", "attempt_id": "0f41a48e3b3f", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.874530Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 226.87454207334667, "ttft_ms": 11.904707993380725, "decode_ms": 119.04387490358204}, "total_wall_ms": 51763.96646024659, "ttft_ms": 11.904707993380725, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,777", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "3894c3c39e5c76c297dfb1859a5e1724e2454039e072357510c841bc907d01a5"} | ||||
| 6898 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "edc488dc9231b9ba0fcc4ff0", "attempt_id": "ddc061e2b281", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.247702Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.00095898471773, "ttft_ms": 11.933500063605607, "decode_ms": 11.876834090799093}, "total_wall_ms": 51656.951210228726, "ttft_ms": 11.933500063605607, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6899 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7fb0d639e291adf520c80ab8", "attempt_id": "a2f2e9a8fbfe", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.514050Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.1774170221761, "ttft_ms": 11.896083015017211, "decode_ms": 11.803666944615543}, "total_wall_ms": 51657.00679330621, "ttft_ms": 11.896083015017211, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6900 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "78503e57a1b0783db6da36c3", "attempt_id": "2dd8e8d64a86", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.780586Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 226.98229097295552, "ttft_ms": 11.855292017571628, "decode_ms": 11.927249957807362}, "total_wall_ms": 51656.907084281556, "ttft_ms": 11.855292017571628, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6901 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dc91bf3256611aa501924736", "attempt_id": "f8fd82f647e2", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:54.929608Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 411, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 161.8083749199286, "ttft_ms": 11.755542014725506, "decode_ms": 11.817999999038875}, "total_wall_ms": 7066.811042022891, "ttft_ms": 11.755542014725506, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6902 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6cbe80d42f9714060a2991d0", "attempt_id": "8c6a5a6dbe22", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.130994Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 418, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.06329204235226, "ttft_ms": 11.834666947834194, "decode_ms": 11.84266700875014}, "total_wall_ms": 7068.1651250924915, "ttft_ms": 11.834666947834194, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6903 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b0ad1d43e019fa53ed4f0173", "attempt_id": "478a77e6a2c0", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.333579Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 417, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.7220829250291, "ttft_ms": 11.770875076763332, "decode_ms": 11.774334008805454}, "total_wall_ms": 7067.642375943251, "ttft_ms": 11.770875076763332, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6904 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "788a17db9e1537b34287249a", "attempt_id": "6631850234e7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.535125Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.14337502606213, "ttft_ms": 11.827750015072525, "decode_ms": 105.74670799542218}, "total_wall_ms": 7161.081625963561, "ttft_ms": 11.827750015072525, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 6905 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9460e4679fa38b776c8c592f", "attempt_id": "5022e9728bd7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.830167Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.51045900955796, "ttft_ms": 11.79112505633384, "decode_ms": 11.737541994079947}, "total_wall_ms": 7068.429584032856, "ttft_ms": 11.79112505633384, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6906 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d7b5715c41d1321977f4f986", "attempt_id": "624a3ba78665", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.032452Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.4532919852063, "ttft_ms": 11.797582963481545, "decode_ms": 117.62612499296665}, "total_wall_ms": 7174.235957907513, "ttft_ms": 11.797582963481545, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 6907 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "52c9e7d825e2534692398267", "attempt_id": "173908bff61e", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.340583Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 161.7492079967633, "ttft_ms": 11.77383295726031, "decode_ms": 11.793666984885931}, "total_wall_ms": 7066.660376032814, "ttft_ms": 11.77383295726031, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6908 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "15721e70ebc62d40ce737d3c", "attempt_id": "0b9700866239", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.541097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 413, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.26837504655123, "ttft_ms": 11.79854094516486, "decode_ms": 11.771459016017616}, "total_wall_ms": 7067.187792039476, "ttft_ms": 11.79854094516486, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6909 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5b731c948e203da928543b78", "attempt_id": "ac3bf59ea017", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.742292Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 164.2026249319315, "ttft_ms": 11.838082922622561, "decode_ms": 105.69224995560944}, "total_wall_ms": 7163.160209078342, "ttft_ms": 11.838082922622561, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 6910 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9f91a40ae69006ed1e5cd02d", "attempt_id": "f6502e223df8", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.039446Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.7134169684723, "ttft_ms": 11.790916905738413, "decode_ms": 94.00495805311948}, "total_wall_ms": 7149.857000098564, "ttft_ms": 11.790916905738413, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | ||||
| 6911 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4cf09811dbc2279993f1a833", "attempt_id": "5b7de7e763f7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.323554Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 430, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 164.0333749819547, "ttft_ms": 11.753374943509698, "decode_ms": 11.779749998822808}, "total_wall_ms": 7068.9538340084255, "ttft_ms": 11.753374943509698, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6912 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59a500566bdd55db455ad8b4", "attempt_id": "794842ffcd57", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.526547Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.1590829929337, "ttft_ms": 11.918083066120744, "decode_ms": 82.08591700531542}, "total_wall_ms": 7138.619584031403, "ttft_ms": 11.918083066120744, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 6913 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "48670f301a79e0bb5d3c71b0", "attempt_id": "e89bed80944f", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.799468Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.70604105759412, "ttft_ms": 11.711874976754189, "decode_ms": 11.718790978193283}, "total_wall_ms": 7068.602624931373, "ttft_ms": 11.711874976754189, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6914 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4646412da99cbc2f36971c9c", "attempt_id": "ef266b3c327b", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:58.002612Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.35641697514802, "ttft_ms": 12.127833091653883, "decode_ms": 11.905333027243614}, "total_wall_ms": 7068.938417010941, "ttft_ms": 12.127833091653883, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6915 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9d26bae2abb3869b62d84b4d", "attempt_id": "5a2f5b547565", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:58.205623Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 425, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.71916695404798, "ttft_ms": 12.210833956487477, "decode_ms": 11.97233295533806}, "total_wall_ms": 7068.44333303161, "ttft_ms": 12.210833956487477, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6916 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a215fb56bdd5d9dcc24ee100", "attempt_id": "6872ee6a37c9", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.286724Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 376, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.5628749895841, "ttft_ms": 11.809916002675891, "decode_ms": 11.738666100427508}, "total_wall_ms": 10923.97341702599, "ttft_ms": 11.809916002675891, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6917 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80f81157a4dd9708955d1999", "attempt_id": "35b9f0e90c25", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.470318Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 383, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 144.05679190531373, "ttft_ms": 11.773000005632639, "decode_ms": 11.773083009757102}, "total_wall_ms": 10924.424584023654, "ttft_ms": 11.773000005632639, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6918 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3c193555e08b06c0c29574bd", "attempt_id": "84b5076b1f98", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.653790Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 382, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.37716600857675, "ttft_ms": 11.903790989890695, "decode_ms": 11.75787509419024}, "total_wall_ms": 10923.935167025775, "ttft_ms": 11.903790989890695, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6919 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a6c018aceca5a88492bcdb91", "attempt_id": "e42cad0c552b", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.837343Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.55033403262496, "ttft_ms": 11.759332963265479, "decode_ms": 105.43054109439254}, "total_wall_ms": 11017.573041957803, "ttft_ms": 11.759332963265479, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 6920 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "583deff437bb60efb1b6c8f8", "attempt_id": "63ee471a94da", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.114265Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.0157919349149, "ttft_ms": 11.84691593516618, "decode_ms": 11.685207951813936}, "total_wall_ms": 10941.439876100048, "ttft_ms": 11.84691593516618, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6921 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a8f600170f94579ec9585d34", "attempt_id": "6b9c20cf7d3f", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.314364Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.33524992596358, "ttft_ms": 11.749166995286942, "decode_ms": 116.95554200559855}, "total_wall_ms": 11027.872417122126, "ttft_ms": 11.749166995286942, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 6922 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc8cecc338f4d774bf3db62a", "attempt_id": "850bc39cf5ff", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.601080Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.05870793759823, "ttft_ms": 12.021500035189092, "decode_ms": 11.887499946169555}, "total_wall_ms": 10923.935708007775, "ttft_ms": 12.021500035189092, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6923 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cdef368123aba3a0bbe72e54", "attempt_id": "364d8e70244c", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.783684Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 378, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.8997089387849, "ttft_ms": 12.004165910184383, "decode_ms": 11.800624895840883}, "total_wall_ms": 10923.662667046301, "ttft_ms": 12.004165910184383, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6924 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6481b95b4e7bb581fbe16fe3", "attempt_id": "4236d1c6f117", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.968321Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 392, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.11570899374783, "ttft_ms": 12.195707997307181, "decode_ms": 106.42774996813387}, "total_wall_ms": 11036.710750078782, "ttft_ms": 12.195707997307181, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 6925 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1544335c4a8e6a5ff2c7427e", "attempt_id": "27cfaf6f0bd2", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.266219Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.22429203800857, "ttft_ms": 12.08758307620883, "decode_ms": 82.41825003642589}, "total_wall_ms": 10993.69737599045, "ttft_ms": 12.08758307620883, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 6926 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8edca167e09f3375bc616adf", "attempt_id": "bc297b7098fc", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.520972Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 395, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.3340419717133, "ttft_ms": 12.025582953356206, "decode_ms": 11.966958991251886}, "total_wall_ms": 10942.332791979425, "ttft_ms": 12.025582953356206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6927 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3dee557e0c4e200d2b200a6f", "attempt_id": "d4b530b0131e", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.724024Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 160.82124994136393, "ttft_ms": 12.035874999128282, "decode_ms": 82.46141695417464}, "total_wall_ms": 11012.295959051698, "ttft_ms": 12.035874999128282, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 6928 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a1ba19e6806d21bca12e1e30", "attempt_id": "db44ca22e817", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.997627Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.9430419811979, "ttft_ms": 12.168082990683615, "decode_ms": 11.824416927993298}, "total_wall_ms": 10923.923125024885, "ttft_ms": 12.168082990683615, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6929 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49c0f71b6f88463fac3f55ca", "attempt_id": "90543c38e07d", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:05.181995Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 160.85291700437665, "ttft_ms": 12.146541033871472, "decode_ms": 11.815583100542426}, "total_wall_ms": 10941.807334078476, "ttft_ms": 12.146541033871472, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6930 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9dbf30fd230eb6add33b7d79", "attempt_id": "08bdc60456e6", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:05.385180Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 390, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.5862079197541, "ttft_ms": 11.996874934993684, "decode_ms": 11.793666053563356}, "total_wall_ms": 10942.224792088382, "ttft_ms": 11.996874934993684, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6931 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4f5d4177a9dc907602e5718c", "attempt_id": "9c75de4c2aba", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.261493Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 376, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 143.47737503703684, "ttft_ms": 11.812917073257267, "decode_ms": 11.73145801294595}, "total_wall_ms": 18594.766833935864, "ttft_ms": 11.812917073257267, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6932 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef0d4761efbfeb625f4e83a0", "attempt_id": "800fcb539538", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.446274Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 383, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.933415947482, "ttft_ms": 11.707625002600253, "decode_ms": 11.721999966539443}, "total_wall_ms": 18593.97570893634, "ttft_ms": 11.707625002600253, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6933 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "acd7c806044d2865c211698c", "attempt_id": "09d0aa57434a", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.628620Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 382, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 143.11829104553908, "ttft_ms": 11.913125053979456, "decode_ms": 11.759917018935084}, "total_wall_ms": 18594.487750902772, "ttft_ms": 11.913125053979456, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6934 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "26e86c5173d8d85f6653ab36", "attempt_id": "889ee085ddd1", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.810524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.85570802167058, "ttft_ms": 11.718833004124463, "decode_ms": 105.01845797989517}, "total_wall_ms": 18687.208874849603, "ttft_ms": 11.718833004124463, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 6935 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ffaa203ef1d4b65f1d36afd", "attempt_id": "2ee3b872449e", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.085957Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 160.48441699240357, "ttft_ms": 11.946541955694556, "decode_ms": 12.141457991674542}, "total_wall_ms": 18612.320083891973, "ttft_ms": 11.946541955694556, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6936 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad4e51d3cdda20f19eaa8b88", "attempt_id": "c91a46c19aa2", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.287565Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.1923750312999, "ttft_ms": 11.8681670865044, "decode_ms": 116.82800005655736}, "total_wall_ms": 18698.578042909503, "ttft_ms": 11.8681670865044, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 6937 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c668cf3ab0edfcf4abfa601b", "attempt_id": "8d70f5c596d9", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.574961Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.60345802176744, "ttft_ms": 11.67291693855077, "decode_ms": 11.709416983649135}, "total_wall_ms": 18593.607750954106, "ttft_ms": 11.67291693855077, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6938 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b51667ccdaeeb0ae4660d84", "attempt_id": "8eb52c29d750", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.756334Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 378, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 143.4065829962492, "ttft_ms": 11.7488750256598, "decode_ms": 11.724249925464392}, "total_wall_ms": 18594.483333989047, "ttft_ms": 11.7488750256598, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6939 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f4776219be502d00b1023137", "attempt_id": "5897f745b2d8", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.938340Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 392, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.03537497110665, "ttft_ms": 11.804500012658536, "decode_ms": 105.1398329436779}, "total_wall_ms": 18705.592874903232, "ttft_ms": 11.804500012658536, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 6940 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b6ef64ee6a56ca1233d7517", "attempt_id": "02efce2f7fe0", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.231234Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.64912507496774, "ttft_ms": 11.904458049684763, "decode_ms": 81.76762494258583}, "total_wall_ms": 18663.90858392697, "ttft_ms": 11.904458049684763, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 6941 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "196de3234c02bae78e1c224e", "attempt_id": "90583394cd53", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.482626Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 395, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.09754191711545, "ttft_ms": 11.719250003807247, "decode_ms": 11.691750027239323}, "total_wall_ms": 18612.112749833614, "ttft_ms": 11.719250003807247, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6942 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae88c3e3f1a5578f7a126f8f", "attempt_id": "11cfa484a26b", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.682528Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 160.5674580205232, "ttft_ms": 11.716125067323446, "decode_ms": 81.88541699200869}, "total_wall_ms": 18681.780041893944, "ttft_ms": 11.716125067323446, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 6943 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ddd746d82af591115750f48f", "attempt_id": "e072aa26f2ad", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.952026Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.90795801207423, "ttft_ms": 11.818624916486442, "decode_ms": 11.799416039139032}, "total_wall_ms": 18594.124916940928, "ttft_ms": 11.818624916486442, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6944 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ce8bd9c159c29e14f8bf882d", "attempt_id": "e1ccebf41b6f", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:16.133793Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.0071249306202, "ttft_ms": 11.830665986053646, "decode_ms": 11.767374933697283}, "total_wall_ms": 18612.18333384022, "ttft_ms": 11.830665986053646, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6945 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fc70f0d4f80b35e40c9b8113", "attempt_id": "77a828a66882", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:16.333405Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 390, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.34524997323751, "ttft_ms": 11.964292032644153, "decode_ms": 11.853417032398283}, "total_wall_ms": 18612.765374942683, "ttft_ms": 11.964292032644153, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6946 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b173341cbe379c0d0a7b28b3", "attempt_id": "d975d197e761", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:31.882605Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 376, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.2176660746336, "ttft_ms": 11.783457943238318, "decode_ms": 11.821625055745244}, "total_wall_ms": 33938.74595896341, "ttft_ms": 11.783457943238318, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6947 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "44220c9c7d7054b6eaf60f0c", "attempt_id": "940c762f4e53", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.065894Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 383, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.8692919909954, "ttft_ms": 11.777416919358075, "decode_ms": 11.827833019196987}, "total_wall_ms": 33939.367875806056, "ttft_ms": 11.777416919358075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6948 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "86f81738fcaa1956a8116c38", "attempt_id": "e3b7dddcba8e", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.249212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 382, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.66883295588195, "ttft_ms": 11.724208015948534, "decode_ms": 12.064500013366342}, "total_wall_ms": 33939.35116683133, "ttft_ms": 11.724208015948534, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6949 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a8f9525849fb21de402671dc", "attempt_id": "c8d0a59299ba", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.432388Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.6260410118848, "ttft_ms": 11.769667034968734, "decode_ms": 106.04074993170798}, "total_wall_ms": 34033.34854298737, "ttft_ms": 11.769667034968734, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 6950 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "beae63f4a02dac2ef15d56ca", "attempt_id": "10b189f7899b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.709415Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.79454205464572, "ttft_ms": 11.829916038550436, "decode_ms": 11.93750009406358}, "total_wall_ms": 33956.46762591787, "ttft_ms": 11.829916038550436, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6951 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dd92271a33962db624b25f6b", "attempt_id": "1484da0a2689", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.909683Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.5096249440685, "ttft_ms": 11.806208989582956, "decode_ms": 118.01516695413738}, "total_wall_ms": 34044.2333339015, "ttft_ms": 11.806208989582956, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 6952 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ce8546e294d327883c78944", "attempt_id": "f1521c6475b2", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.197715Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.50408292375505, "ttft_ms": 11.811125092208385, "decode_ms": 11.785084032453597}, "total_wall_ms": 33938.9966679737, "ttft_ms": 11.811125092208385, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6953 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "14e2316bae62e3150e5da7ed", "attempt_id": "f22028da1af3", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.380636Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 378, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.95812498312443, "ttft_ms": 11.813041986897588, "decode_ms": 11.816457961685956}, "total_wall_ms": 33938.47612594254, "ttft_ms": 11.813041986897588, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6954 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "190ff5864d9c0a9fa6431bc6", "attempt_id": "af2a960bdb29", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.562613Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 392, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 161.10620892141014, "ttft_ms": 11.814457946456969, "decode_ms": 105.62295897398144}, "total_wall_ms": 34050.455209915526, "ttft_ms": 11.814457946456969, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 6955 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "78b59f8fc9ce016fc86219b8", "attempt_id": "536c3afe262c", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.856274Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.65770895872265, "ttft_ms": 11.740584042854607, "decode_ms": 81.82291698176414}, "total_wall_ms": 34008.11458390672, "ttft_ms": 11.740584042854607, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 6956 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8d16664747a264fac994528e", "attempt_id": "6aada17c4c14", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.108050Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 395, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.55770800448954, "ttft_ms": 11.701749986968935, "decode_ms": 11.696540983393788}, "total_wall_ms": 33955.845542950556, "ttft_ms": 11.701749986968935, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6957 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f66ab10c7154687f9b902c04", "attempt_id": "3f680ff9bd41", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.307316Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.3999580256641, "ttft_ms": 11.728040990419686, "decode_ms": 81.81229105684906}, "total_wall_ms": 34025.84295999259, "ttft_ms": 11.728040990419686, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 6958 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8d705cddf11cf741f5df60e0", "attempt_id": "d0314846e27e", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.576471Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.28320808615535, "ttft_ms": 11.696208966895938, "decode_ms": 11.715666973032057}, "total_wall_ms": 33937.57891689893, "ttft_ms": 11.696208966895938, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6959 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0d319a0a906287feb1d2ce9", "attempt_id": "f7535372e763", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.757606Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.82045796792954, "ttft_ms": 11.703249998390675, "decode_ms": 11.678499984554946}, "total_wall_ms": 33956.093625864014, "ttft_ms": 11.703249998390675, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6960 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d3eaf196ab4168c641de924", "attempt_id": "553728977050", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.957283Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 390, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.95841699279845, "ttft_ms": 11.682874988764524, "decode_ms": 11.715583968907595}, "total_wall_ms": 33956.26037591137, "ttft_ms": 11.682874988764524, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6961 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6e6fd989c552471cceede09d", "attempt_id": "0c3d90351834", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:42.072957Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 225.96166701987386, "ttft_ms": 12.14233401697129, "decode_ms": 12.142083025537431}, "total_wall_ms": 7164.618417038582, "ttft_ms": 12.14233401697129, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6962 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b985e7ee755f590f19dd7ced", "attempt_id": "1f364c6119a6", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:42.340858Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.10537498258054, "ttft_ms": 12.183125014416873, "decode_ms": 143.83104199077934}, "total_wall_ms": 7296.495040995069, "ttft_ms": 12.183125014416873, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 6963 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "548a8796c91c2ecf2521bbd7", "attempt_id": "5e01c238a318", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:42.740299Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.22108296491206, "ttft_ms": 12.253916938789189, "decode_ms": 84.06479202676564}, "total_wall_ms": 7236.934624030255, "ttft_ms": 12.253916938789189, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 6964 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "39c511551d0929cbd8c30526", "attempt_id": "9aa07bc3c245", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.080421Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.4239169890061, "ttft_ms": 12.130500050261617, "decode_ms": 107.62237501330674}, "total_wall_ms": 7260.570583050139, "ttft_ms": 12.130500050261617, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 6965 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6b2b4122f63542287d3f9fba", "attempt_id": "7471bc7cb223", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.444163Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.8315830733627, "ttft_ms": 12.146459077484906, "decode_ms": 11.996458051726222}, "total_wall_ms": 7165.376124088652, "ttft_ms": 12.146459077484906, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6966 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a1bb68080696d7ada6bcc03", "attempt_id": "15265438a15d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.713002Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.76500002853572, "ttft_ms": 12.177166994661093, "decode_ms": 11.972832959145308}, "total_wall_ms": 7165.297083090991, "ttft_ms": 12.177166994661093, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6967 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9e4325b1939b80f9c577f774", "attempt_id": "29f482ef35a7", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.981236Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.59629094414413, "ttft_ms": 12.120499974116683, "decode_ms": 11.998625006526709}, "total_wall_ms": 7165.1322490070015, "ttft_ms": 12.120499974116683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6968 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "327c40a35449264958ac7ec0", "attempt_id": "f6ffd1b7f38b", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:44.249810Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.79187497124076, "ttft_ms": 12.165124993771315, "decode_ms": 11.956791044212878}, "total_wall_ms": 7165.306583046913, "ttft_ms": 12.165124993771315, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6969 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "62ad7b40251cf5a894e0e5f5", "attempt_id": "f599a6e76ed3", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:44.519082Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 229.277583071962, "ttft_ms": 12.159582925960422, "decode_ms": 84.08250007778406}, "total_wall_ms": 7239.922000095248, "ttft_ms": 12.159582925960422, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 6970 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "757649df8e9bbc3b12bc3ed2", "attempt_id": "e0ea438959ef", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:44.862223Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.67512495536357, "ttft_ms": 12.085333000868559, "decode_ms": 107.8914999961853}, "total_wall_ms": 7261.088541010395, "ttft_ms": 12.085333000868559, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 6971 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bdcbc28dec2dfaa66c061550", "attempt_id": "72a15ea591a0", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.226549Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 228.9500420447439, "ttft_ms": 12.183125014416873, "decode_ms": 83.30258296336979}, "total_wall_ms": 7238.800166058354, "ttft_ms": 12.183125014416873, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 6972 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6d5f31a9df67f6e222bc2ae", "attempt_id": "d538ccfd6487", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.568474Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.82812495622784, "ttft_ms": 12.169958092272282, "decode_ms": 118.85733297094703}, "total_wall_ms": 7272.266249055974, "ttft_ms": 12.169958092272282, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,077", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "2044d7c4afd32892ac22705680e35174db83308c139b02a1494275cc5e24aff3"} | ||||
| 6973 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b9a6db463aabbfd242e621b6", "attempt_id": "b3d8766da95d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.943582Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.58933291677386, "ttft_ms": 12.23166601266712, "decode_ms": 12.016292079351842}, "total_wall_ms": 7165.241083013825, "ttft_ms": 12.23166601266712, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6974 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "64a3724f1f53f0a670e85247", "attempt_id": "11b0e4adb5b3", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:46.212212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 227.10920800454915, "ttft_ms": 12.291125021874905, "decode_ms": 12.066417024470866}, "total_wall_ms": 7165.863624075428, "ttft_ms": 12.291125021874905, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6975 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9cef6c4a91ca520c14ebc0fc", "attempt_id": "146173a7e154", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:46.481119Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.86308296397328, "ttft_ms": 12.225582962855697, "decode_ms": 12.079791980795562}, "total_wall_ms": 7165.599124040455, "ttft_ms": 12.225582962855697, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6976 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df0dbdc3889b2a6c345d19f2", "attempt_id": "350b58766205", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:53.289390Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.35254205670208, "ttft_ms": 12.28716701734811, "decode_ms": 12.075082981027663}, "total_wall_ms": 13702.642832999118, "ttft_ms": 12.28716701734811, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6977 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5cf7b6c029ac4818104d7115", "attempt_id": "a6d7f037b37e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:53.558294Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.64000000804663, "ttft_ms": 12.293500010855496, "decode_ms": 143.57829198706895}, "total_wall_ms": 13834.429916925728, "ttft_ms": 12.293500010855496, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 6978 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "08a8bc058ab123854ed02cdc", "attempt_id": "b9ab57669002", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:53.958453Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.69533302541822, "ttft_ms": 12.066500028595328, "decode_ms": 83.11524998862296}, "total_wall_ms": 13773.747792001814, "ttft_ms": 12.066500028595328, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 6979 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d08ecc1335c91e9ce6267148", "attempt_id": "726638d270fd", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:54.297839Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.5240829437971, "ttft_ms": 11.990500031970441, "decode_ms": 106.53254191856831}, "total_wall_ms": 13796.93720897194, "ttft_ms": 11.990500031970441, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 6980 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b06892989a5155729f89fa32", "attempt_id": "5f63ac8f803c", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:54.660596Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.84458293952048, "ttft_ms": 12.060915934853256, "decode_ms": 11.918332893401384}, "total_wall_ms": 13702.739875065163, "ttft_ms": 12.060915934853256, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6981 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fff346f880d82842e6b4cbea", "attempt_id": "0dc009303f2f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:54.929017Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.62308299914002, "ttft_ms": 12.006666045635939, "decode_ms": 11.951415915973485}, "total_wall_ms": 13702.495709061623, "ttft_ms": 12.006666045635939, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6982 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d62e55029a0ba2cd7e09c719", "attempt_id": "41e92ce0fe55", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:55.197097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.68587497901171, "ttft_ms": 11.990415980108082, "decode_ms": 11.908792075701058}, "total_wall_ms": 13702.452500117943, "ttft_ms": 11.990415980108082, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6983 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6da39d4d588b902897721ebe", "attempt_id": "7c8707a7d761", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:55.465343Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.7853330122307, "ttft_ms": 11.99666690081358, "decode_ms": 11.910333065316081}, "total_wall_ms": 13702.584250015207, "ttft_ms": 11.99666690081358, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6984 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a83ba17574baa40d711dab88", "attempt_id": "0c93cab1f249", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:55.733341Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 228.2851659692824, "ttft_ms": 12.088999967090786, "decode_ms": 83.26541702263057}, "total_wall_ms": 13775.558584020473, "ttft_ms": 12.088999967090786, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 6985 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "33c1495d050ae225bec74528", "attempt_id": "041173017e3f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:56.074276Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.19133302941918, "ttft_ms": 12.269999948330224, "decode_ms": 82.75495795533061}, "total_wall_ms": 13773.125833948143, "ttft_ms": 12.269999948330224, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 6986 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7cdc4b421e72469d18bd94f", "attempt_id": "394a75b23025", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:56.412546Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 228.50770794320852, "ttft_ms": 12.111791060306132, "decode_ms": 82.78241602238268}, "total_wall_ms": 13775.284833973274, "ttft_ms": 12.111791060306132, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 6987 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d9de66d05b9d383c900d69a5", "attempt_id": "3c26a3fa35cb", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:56.753059Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.88262502197176, "ttft_ms": 12.022458016872406, "decode_ms": 106.70112492516637}, "total_wall_ms": 13797.50537511427, "ttft_ms": 12.022458016872406, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | ||||
| 6988 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "57b4ec7e0d27a3d7fc0cf8e4", "attempt_id": "02b853b2d02e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:57.115881Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.58875002525747, "ttft_ms": 12.043667025864124, "decode_ms": 11.88120897859335}, "total_wall_ms": 13702.396042062901, "ttft_ms": 12.043667025864124, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6989 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b696778534835305efdbfb84", "attempt_id": "5f15c6112c61", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:57.383842Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.85708303470165, "ttft_ms": 12.016250053420663, "decode_ms": 11.925583006814122}, "total_wall_ms": 13702.708334079944, "ttft_ms": 12.016250053420663, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6990 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a76d42e6f7af180e2ae75f9", "attempt_id": "1ea029929a79", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:57.652009Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 227.03512501902878, "ttft_ms": 12.07654201425612, "decode_ms": 11.895833071321249}, "total_wall_ms": 13702.917042071931, "ttft_ms": 12.07654201425612, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6991 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d9edfad527989a186700f618", "attempt_id": "9ab32be73dd6", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:10.898438Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.20100004132837, "ttft_ms": 12.043249909766018, "decode_ms": 11.869083042256534}, "total_wall_ms": 26676.909374888055, "ttft_ms": 12.043249909766018, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6992 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89cc6c4231d348a92ae1c360", "attempt_id": "554978bdb979", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:11.166060Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.74266702961177, "ttft_ms": 12.103458982892334, "decode_ms": 142.3419580096379}, "total_wall_ms": 26807.97545891255, "ttft_ms": 12.103458982892334, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 6993 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7cb051c1c46a0bcf7a727733", "attempt_id": "1aa4eb2e9bf4", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:11.564427Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.67437500786036, "ttft_ms": 11.96850009728223, "decode_ms": 84.03270808048546}, "total_wall_ms": 26749.359791981988, "ttft_ms": 11.96850009728223, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 6994 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6d9f808101708f68c960c3aa", "attempt_id": "447a22f1d5ab", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:11.904778Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.30774998106062, "ttft_ms": 12.088541989214718, "decode_ms": 106.47579201031476}, "total_wall_ms": 26771.668457891792, "ttft_ms": 12.088541989214718, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 6995 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7fbef4fe984176467b6c5f17", "attempt_id": "738c12f40b4c", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:12.266795Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.79329197853804, "ttft_ms": 12.054541031830013, "decode_ms": 12.051792000420392}, "total_wall_ms": 26677.702624816447, "ttft_ms": 12.054541031830013, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6996 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7814552da275c5d5d653991", "attempt_id": "a2a35a8c7a74", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:12.534918Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.98087489698082, "ttft_ms": 12.00774998869747, "decode_ms": 11.901167104952037}, "total_wall_ms": 26677.675499930046, "ttft_ms": 12.00774998869747, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6997 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c2cb6639cb073103e140adc2", "attempt_id": "e8fa8930ff14", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:12.803172Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.3444580603391, "ttft_ms": 12.020500027574599, "decode_ms": 12.003917014226317}, "total_wall_ms": 26677.15237592347, "ttft_ms": 12.020500027574599, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 6998 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a9e5768ece59f38e62e92ef4", "attempt_id": "7e8dd2c472ce", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:13.071146Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.0023329872638, "ttft_ms": 12.39254092797637, "decode_ms": 12.073875055648386}, "total_wall_ms": 26677.256583818235, "ttft_ms": 12.39254092797637, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 6999 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16081d619c57b203592d22f9", "attempt_id": "63674f47490a", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:13.338648Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 228.54979196563363, "ttft_ms": 12.095917016267776, "decode_ms": 83.30291707534343}, "total_wall_ms": 26750.76162489131, "ttft_ms": 12.095917016267776, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 7000 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2547156712741e8aac6a6cdf", "attempt_id": "60a208b3fe78", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:13.680175Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.7534170532599, "ttft_ms": 12.13912502862513, "decode_ms": 83.0200829077512}, "total_wall_ms": 26748.7223749049, "ttft_ms": 12.13912502862513, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 7001 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cba452fd0ef4d0ad5eee6d55", "attempt_id": "f113f24d7ee1", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.019455Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 228.5613330313936, "ttft_ms": 12.18979200348258, "decode_ms": 83.81041698157787}, "total_wall_ms": 26751.38504197821, "ttft_ms": 12.18979200348258, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 7002 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "77c228a0255d05bd3e716f7a", "attempt_id": "8dca5e3ee55f", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.361333Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 227.13570797350258, "ttft_ms": 12.029916979372501, "decode_ms": 106.78820800967515}, "total_wall_ms": 26772.779416874982, "ttft_ms": 12.029916979372501, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | ||||
| 7003 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90f071cd7a7512b245abfaf4", "attempt_id": "7fc026131e9f", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.725338Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.80549998767674, "ttft_ms": 11.990292114205658, "decode_ms": 11.960500036366284}, "total_wall_ms": 26677.562749944627, "ttft_ms": 11.990292114205658, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7004 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be95d7f7e3a3c4a6c32f37c2", "attempt_id": "a19119267cf5", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.993732Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 227.09733399096876, "ttft_ms": 12.04025000333786, "decode_ms": 12.06674997229129}, "total_wall_ms": 26678.004707908258, "ttft_ms": 12.04025000333786, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7005 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8c86339a3eb4ef398fe6e60", "attempt_id": "ed9390d91aec", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:15.262618Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.85412492137402, "ttft_ms": 12.025041971355677, "decode_ms": 11.947166989557445}, "total_wall_ms": 26677.633916959167, "ttft_ms": 12.025041971355677, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7006 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1aeb5f54937e2da6c8994065", "attempt_id": "84421481d492", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:41.492059Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.67104098945856, "ttft_ms": 12.146624969318509, "decode_ms": 11.900875018909574}, "total_wall_ms": 52633.19920876529, "ttft_ms": 12.146624969318509, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7007 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f9bf270ea8291e919e4a1a5", "attempt_id": "ad561d8fbe8c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:41.760404Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.53450001962483, "ttft_ms": 12.05608295276761, "decode_ms": 142.4653750145808}, "total_wall_ms": 52763.53699970059, "ttft_ms": 12.05608295276761, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 7008 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02f5591b35570cef9a088d74", "attempt_id": "515f7bc01037", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:42.158505Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.54391604010016, "ttft_ms": 12.045416980981827, "decode_ms": 83.09945906512439}, "total_wall_ms": 52704.16529173963, "ttft_ms": 12.045416980981827, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 7009 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e6868a843a0607f2e10955b", "attempt_id": "4feec602560f", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:42.497689Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.34745901450515, "ttft_ms": 12.016375083476305, "decode_ms": 106.95979208685458}, "total_wall_ms": 52727.82749973703, "ttft_ms": 12.016375083476305, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7010 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c690b3481e12ef11a37e8bd8", "attempt_id": "2b32d4dc5ecb", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:42.860218Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.99391597416252, "ttft_ms": 12.069249991327524, "decode_ms": 11.948042083531618}, "total_wall_ms": 52633.48758383654, "ttft_ms": 12.069249991327524, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7011 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d10c2a97d11f73b5ef257795", "attempt_id": "382b8e78bdc2", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.128682Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.90041607711464, "ttft_ms": 12.111415970139205, "decode_ms": 11.93616702221334}, "total_wall_ms": 52633.430541842245, "ttft_ms": 12.111415970139205, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7012 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e404a7952c0b16c741688be7", "attempt_id": "c8df5a819e29", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.397029Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.5007080277428, "ttft_ms": 12.092125019989908, "decode_ms": 11.913749971427023}, "total_wall_ms": 52632.952208747156, "ttft_ms": 12.092125019989908, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7013 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9472f66c3be2613e05c931a8", "attempt_id": "020415f015e0", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.664623Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.55254194978625, "ttft_ms": 12.070374912582338, "decode_ms": 11.949707986786962}, "total_wall_ms": 52633.06937471498, "ttft_ms": 12.070374912582338, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 7014 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bbabcc96cd5a72fe8435034a", "attempt_id": "4c3758da9756", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.932245Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 228.38616697117686, "ttft_ms": 12.151625007390976, "decode_ms": 83.05100002326071}, "total_wall_ms": 52706.074374727905, "ttft_ms": 12.151625007390976, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 7015 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "034ef50cc7813b185f117602", "attempt_id": "90e5c712bda0", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:44.273141Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.02399997413158, "ttft_ms": 12.103083077818155, "decode_ms": 83.07608298491687}, "total_wall_ms": 52703.70483270381, "ttft_ms": 12.103083077818155, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 7016 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b31d55d64cec5592c667b90", "attempt_id": "92a51ed65cb9", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:44.612304Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 228.62429195083678, "ttft_ms": 12.161041027866304, "decode_ms": 83.1940839998424}, "total_wall_ms": 52706.45424979739, "ttft_ms": 12.161041027866304, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 7017 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad6f532b3b569a830dcf7911", "attempt_id": "22e400367940", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:44.953782Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.94208403117955, "ttft_ms": 12.143999920226634, "decode_ms": 119.12737495731562}, "total_wall_ms": 52740.74666574597, "ttft_ms": 12.143999920226634, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,777", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "3894c3c39e5c76c297dfb1859a5e1724e2454039e072357510c841bc907d01a5"} | ||||
| 7018 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b84b69525c6fcba469e0f1b8", "attempt_id": "6a67ca0887d2", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:45.330111Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.91083303652704, "ttft_ms": 12.10962503682822, "decode_ms": 12.047167052514851}, "total_wall_ms": 52633.554916712455, "ttft_ms": 12.10962503682822, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7019 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3a6ef133feda9ecc7a8e4e63", "attempt_id": "3e87f416fec5", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:45.599182Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.62904195021838, "ttft_ms": 12.135457945987582, "decode_ms": 11.944000027142465}, "total_wall_ms": 52633.18341667764, "ttft_ms": 12.135457945987582, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7020 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4a334d56e7944cbea659c31e", "attempt_id": "d308556439b7", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:45.867476Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.80845798458904, "ttft_ms": 12.105750036425889, "decode_ms": 11.993582942523062}, "total_wall_ms": 52633.39083374012, "ttft_ms": 12.105750036425889, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7021 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dab64d0a547352a5de2a9544", "attempt_id": "13793f9a59d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.041817Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 411, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 161.35308309458196, "ttft_ms": 11.968999984674156, "decode_ms": 11.747209005989134}, "total_wall_ms": 7090.143167064525, "ttft_ms": 11.968999984674156, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7022 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "98e33e69fcd96548462d24e8", "attempt_id": "1f644926e934", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.244476Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 418, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.33229194767773, "ttft_ms": 12.009500060230494, "decode_ms": 11.792459059506655}, "total_wall_ms": 7091.230208054185, "ttft_ms": 12.009500060230494, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7023 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5fc6b89d06b24bae9d1c3f3a", "attempt_id": "af09ad849a74", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.448073Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 417, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.48287493363023, "ttft_ms": 11.940457974560559, "decode_ms": 11.760167079046369}, "total_wall_ms": 7091.2466669688, "ttft_ms": 11.940457974560559, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7024 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aa2a802f302d6af100ca2314", "attempt_id": "949a3ae10a75", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.651464Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 161.80162504315376, "ttft_ms": 12.081459048204124, "decode_ms": 106.64941591676325}, "total_wall_ms": 7185.678042005748, "ttft_ms": 12.081459048204124, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7025 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83714a2aa1eb09dc4279d2d0", "attempt_id": "bc10c9c8df81", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.949155Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.68145805224776, "ttft_ms": 11.984875076450408, "decode_ms": 11.788874980993569}, "total_wall_ms": 7091.526416945271, "ttft_ms": 11.984875076450408, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7026 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6bd30c8f10b52862d5810f45", "attempt_id": "7d2fe4959243", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.152836Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.5219580018893, "ttft_ms": 12.112334021367133, "decode_ms": 118.49020794034004}, "total_wall_ms": 7198.215292068198, "ttft_ms": 12.112334021367133, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 7027 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b7896adeafc7d849a4c3a0af", "attempt_id": "11e6a2cd6e04", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.463119Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.01400000136346, "ttft_ms": 11.932500055991113, "decode_ms": 11.78358297329396}, "total_wall_ms": 7090.810250956565, "ttft_ms": 11.932500055991113, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7028 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "62d9ca57dfb4018dc86169d0", "attempt_id": "72f06d99d7df", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.665921Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 413, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 161.93608404137194, "ttft_ms": 11.971125029958785, "decode_ms": 11.868417030200362}, "total_wall_ms": 7090.858459006995, "ttft_ms": 11.971125029958785, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7029 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc3895362ef22e676128c686", "attempt_id": "60e76ad9438f", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.868576Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.84087498206645, "ttft_ms": 11.946416925638914, "decode_ms": 105.67383305169642}, "total_wall_ms": 7185.53083401639, "ttft_ms": 11.946416925638914, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 7030 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9e7f5534461c015a02fa459f", "attempt_id": "dfdd77e8b190", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.165960Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.5372909475118, "ttft_ms": 11.957375099882483, "decode_ms": 93.99795904755592}, "total_wall_ms": 7173.577666981146, "ttft_ms": 11.957375099882483, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | ||||
| 7031 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9bea21ab7d2e05318774b882", "attempt_id": "c24f4d354a96", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.451771Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 430, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.81020897440612, "ttft_ms": 11.880208039656281, "decode_ms": 11.8079170351848}, "total_wall_ms": 7091.553583042696, "ttft_ms": 11.880208039656281, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7032 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "805673cfffe8889e3fd2bff6", "attempt_id": "424674c91996", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.655480Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.78024995699525, "ttft_ms": 11.979625094681978, "decode_ms": 82.71695801522583}, "total_wall_ms": 7162.57908300031, "ttft_ms": 11.979625094681978, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 7033 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "69eab1984a9641b97adf6fc1", "attempt_id": "0ef1215be621", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.930212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.80720895156264, "ttft_ms": 11.959749972447753, "decode_ms": 11.858667014166713}, "total_wall_ms": 7091.693707974628, "ttft_ms": 11.959749972447753, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7034 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b11dc7bbca785c64eba7d265", "attempt_id": "6d626ab87bb7", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:56.133825Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 163.12254196964204, "ttft_ms": 12.071083998307586, "decode_ms": 11.853625066578388}, "total_wall_ms": 7092.146209091879, "ttft_ms": 12.071083998307586, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7035 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03714abd5e5ec0e00f0eb703", "attempt_id": "6f4a2578c06b", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:56.337725Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 425, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.3170409584418, "ttft_ms": 11.97616697754711, "decode_ms": 11.79329096339643}, "total_wall_ms": 7091.1500009242445, "ttft_ms": 11.97616697754711, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7036 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e775fc3bab68ed83ead8cea7", "attempt_id": "0ae83bca10c1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:00.922722Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.09245810750872, "ttft_ms": 11.985916993580759, "decode_ms": 12.057916959747672}, "total_wall_ms": 11471.509834052995, "ttft_ms": 11.985916993580759, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7037 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1696aaf6c268c3e6658bf492", "attempt_id": "127a32e44648", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.126583Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.84387500490993, "ttft_ms": 11.996875051409006, "decode_ms": 11.861791950650513}, "total_wall_ms": 11472.064876114018, "ttft_ms": 11.996875051409006, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7038 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0d07e34dce806c0e6cb7bed6", "attempt_id": "832687ce30a6", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.330487Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 426, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.6890420448035, "ttft_ms": 12.013040948659182, "decode_ms": 11.781834065914154}, "total_wall_ms": 11471.826125052758, "ttft_ms": 12.013040948659182, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7039 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d8968a0a4346de1fecc8dcb5", "attempt_id": "fe0b5ef8e6a2", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.533918Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.48783294577152, "ttft_ms": 12.087165960110724, "decode_ms": 106.29158304072917}, "total_wall_ms": 11566.244917106815, "ttft_ms": 12.087165960110724, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7040 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d7c55ef06bfb85aedf69d997", "attempt_id": "e1929096b231", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.831743Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.69545897375792, "ttft_ms": 12.013084022328258, "decode_ms": 11.807791073806584}, "total_wall_ms": 11471.873625996523, "ttft_ms": 12.013084022328258, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7041 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "17e55ae417f32d2b1cfa701e", "attempt_id": "fca1fcbc54f1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.035823Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.11737499199808, "ttft_ms": 11.956166941672564, "decode_ms": 117.67824995331466}, "total_wall_ms": 11578.09308404103, "ttft_ms": 11.956166941672564, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 7042 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab5af495ee733eb9022b0f44", "attempt_id": "9889aead7b6e", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.345805Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.54537494387478, "ttft_ms": 11.936415918171406, "decode_ms": 11.806041933596134}, "total_wall_ms": 11471.638292074203, "ttft_ms": 11.936415918171406, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7043 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8dbd1b624ce6756619d5ba71", "attempt_id": "c01f4066c5d1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.548884Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 422, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.00804202910513, "ttft_ms": 11.888957931660116, "decode_ms": 11.774999904446304}, "total_wall_ms": 11472.005667048506, "ttft_ms": 11.888957931660116, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7044 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e771d59b7a17f49bb2df650", "attempt_id": "7f3d6a008293", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.752438Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 436, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.1523750256747, "ttft_ms": 12.022958020679653, "decode_ms": 106.00737505592406}, "total_wall_ms": 11566.529459087178, "ttft_ms": 12.022958020679653, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 7045 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cdd456e1214b18e16a30fac5", "attempt_id": "5e7a25bfad26", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.050493Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.13912498299032, "ttft_ms": 12.226958060637116, "decode_ms": 94.86566693522036}, "total_wall_ms": 11555.596334044822, "ttft_ms": 12.226958060637116, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | ||||
| 7046 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d5fa1ff6cab1fe04d163a98f", "attempt_id": "e3add4802be9", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.338111Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 439, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.31266600172967, "ttft_ms": 11.974875000305474, "decode_ms": 11.80491701234132}, "total_wall_ms": 11472.441207966767, "ttft_ms": 11.974875000305474, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7047 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4886b86ef15b303367702cf0", "attempt_id": "ad0f77ee89ed", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.542500Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.80037490651011, "ttft_ms": 12.014084029942751, "decode_ms": 82.52329204697162}, "total_wall_ms": 11542.69691708032, "ttft_ms": 12.014084029942751, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 7048 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8e825058dd772199c9e5477d", "attempt_id": "1bfcc1f9fe83", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.816780Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.76987502351403, "ttft_ms": 11.977499932982028, "decode_ms": 11.774958111345768}, "total_wall_ms": 11471.862250007689, "ttft_ms": 11.977499932982028, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7049 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "de6ad348ea47793b0c2e5cbc", "attempt_id": "7cdfd5890c82", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:04.020291Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.82299999147654, "ttft_ms": 11.96270901709795, "decode_ms": 11.970332940109074}, "total_wall_ms": 11472.077584010549, "ttft_ms": 11.96270901709795, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7050 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4908d3841e4aa6f2b500f61c", "attempt_id": "8d77966a0093", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:04.223968Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 434, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.1097919307649, "ttft_ms": 11.991541017778218, "decode_ms": 11.808917042799294}, "total_wall_ms": 11472.263500094414, "ttft_ms": 11.991541017778218, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7051 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9c21f8bb1ddde17384c00141", "attempt_id": "fc6bc5a2e662", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.176836Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.25183405913413, "ttft_ms": 11.997958994470537, "decode_ms": 11.784625006839633}, "total_wall_ms": 20218.177042203024, "ttft_ms": 11.997958994470537, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7052 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751f48bf49f0ad6f27c2923c", "attempt_id": "0d3c69cf0d1a", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.380555Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.82395797315985, "ttft_ms": 11.958041926845908, "decode_ms": 11.7972920415923}, "total_wall_ms": 20218.719209195115, "ttft_ms": 11.958041926845908, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7053 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "17756b5049a9ffcad090e3dc", "attempt_id": "2b4b553f47d8", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.584240Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 426, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.5250829383731, "ttft_ms": 11.995665961876512, "decode_ms": 11.941708973608911}, "total_wall_ms": 20218.64683413878, "ttft_ms": 11.995665961876512, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7054 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4fb0caa5a627939e76f5829e", "attempt_id": "c3f6dce83c68", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.787718Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.5159999821335, "ttft_ms": 11.918375035747886, "decode_ms": 105.98783404566348}, "total_wall_ms": 20312.572292168625, "ttft_ms": 11.918375035747886, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7055 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d8d5b194d65cc28b41287ea", "attempt_id": "49fb1f6cdb05", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.084874Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.71654202137142, "ttft_ms": 11.935874936170876, "decode_ms": 11.876665987074375}, "total_wall_ms": 20218.70729222428, "ttft_ms": 11.935874936170876, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7056 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e9b2d46179221737e4c2d757", "attempt_id": "143eb2af9a23", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.288549Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.1305000046268, "ttft_ms": 12.034083949401975, "decode_ms": 117.69745801575482}, "total_wall_ms": 20325.0216251472, "ttft_ms": 12.034083949401975, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 7057 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5048c85a91773bb28f02db4", "attempt_id": "c73e1c7bda90", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.599141Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.68974996637553, "ttft_ms": 11.981167015619576, "decode_ms": 11.93391706328839}, "total_wall_ms": 20218.790667131543, "ttft_ms": 11.981167015619576, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7058 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8a1cf03bd27bfbb71932f5e", "attempt_id": "019f9ca3f15b", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.802881Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 422, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.5451250001788, "ttft_ms": 11.957417009398341, "decode_ms": 11.788124917075038}, "total_wall_ms": 20218.4524590848, "ttft_ms": 11.957417009398341, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7059 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c000a339087b6ea282931afe", "attempt_id": "27a4a925085e", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.006497Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 436, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.19950006436557, "ttft_ms": 12.186832958832383, "decode_ms": 105.9744170634076}, "total_wall_ms": 20313.508458202705, "ttft_ms": 12.186832958832383, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 7060 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2d448014a3e584e8cfd601c7", "attempt_id": "af2cbca5a0f9", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.304998Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.2902089729905, "ttft_ms": 11.997041990980506, "decode_ms": 94.16520793456584}, "total_wall_ms": 20300.61170924455, "ttft_ms": 11.997041990980506, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828865", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b38715dfc60d964ebea3bdcc90d47ca28d803114815818233d093f08214df6ae"} | ||||
| 7061 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7746e3e1fe1d98dd566c83cc", "attempt_id": "d7eb50fd6d38", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.591636Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 439, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.38491695933044, "ttft_ms": 11.889249901287258, "decode_ms": 11.825541034340858}, "total_wall_ms": 20219.235292170197, "ttft_ms": 11.889249901287258, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7062 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d34ecd59b92be4ad062bcd17", "attempt_id": "ad42a4f2d6bf", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.795807Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.17116608843207, "ttft_ms": 12.047125026583672, "decode_ms": 82.41575001738966}, "total_wall_ms": 20289.788750116713, "ttft_ms": 12.047125026583672, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 7063 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0d09153a036bf6cc557aec7b", "attempt_id": "55c108237e98", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.071138Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.26541600190103, "ttft_ms": 11.967791011556983, "decode_ms": 11.867208988405764}, "total_wall_ms": 20218.269708100706, "ttft_ms": 11.967791011556983, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7064 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e7df7cfd0881c4bd8729c5fa", "attempt_id": "f89a2eb1f0b5", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.274252Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.85170800983906, "ttft_ms": 11.99487503618002, "decode_ms": 11.803624918684363}, "total_wall_ms": 20218.79883413203, "ttft_ms": 11.99487503618002, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7065 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71464fbbcc1692cd9e7f4cce", "attempt_id": "6cbe67c15efd", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.478275Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 434, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.19333296269178, "ttft_ms": 11.967458995059133, "decode_ms": 11.754250037483871}, "total_wall_ms": 20219.068792182952, "ttft_ms": 11.967458995059133, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7066 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b4afafb68040b44b9c1fc82c", "attempt_id": "5d6eb1e3f4eb", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.206915Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.8488750429824, "ttft_ms": 11.996084009297192, "decode_ms": 11.838959064334631}, "total_wall_ms": 37738.89483406674, "ttft_ms": 11.996084009297192, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7067 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d6f948964e92b522b70f6569", "attempt_id": "23ad64ba0e56", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.411332Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.86229202523828, "ttft_ms": 11.990666971541941, "decode_ms": 11.968291946686804}, "total_wall_ms": 37738.99479303509, "ttft_ms": 11.990666971541941, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7068 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c00aac3fe9fd50be18cae024", "attempt_id": "8a4b5312840e", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.615554Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 426, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.7461250172928, "ttft_ms": 12.085292022675276, "decode_ms": 11.794500052928925}, "total_wall_ms": 37738.796918070875, "ttft_ms": 12.085292022675276, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7069 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ac28b052817fd71b7c34046d", "attempt_id": "6853feec4d2e", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.819212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.26975002791733, "ttft_ms": 11.933750007301569, "decode_ms": 105.8265829924494}, "total_wall_ms": 37832.18812500127, "ttft_ms": 11.933750007301569, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7070 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9cdbccae53bba2d9a4d44a84", "attempt_id": "f203b1c63fa8", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.116097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.9758341005072, "ttft_ms": 12.005583965219557, "decode_ms": 11.819457984529436}, "total_wall_ms": 37738.981500966474, "ttft_ms": 12.005583965219557, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7071 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "acad1d07d8826bbc007c28f0", "attempt_id": "d5cd60bdd5c8", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.320506Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.78112505096942, "ttft_ms": 11.994667001999915, "decode_ms": 117.7488750545308}, "total_wall_ms": 37844.68225098681, "ttft_ms": 11.994667001999915, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 7072 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a240f56fa53b0d50b39a871", "attempt_id": "52484533d07c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.630298Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.44033304974437, "ttft_ms": 11.959042050875723, "decode_ms": 11.80325006134808}, "total_wall_ms": 37738.37541707326, "ttft_ms": 11.959042050875723, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7073 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "74c23190343c10ac03dbf635", "attempt_id": "df1d707151eb", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.833524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 422, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.72825002670288, "ttft_ms": 12.043875060044229, "decode_ms": 11.784875066950917}, "total_wall_ms": 37738.72566805221, "ttft_ms": 12.043875060044229, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7074 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ee2d494446dd486ca015d17", "attempt_id": "856c43d4ce76", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.036757Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 436, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.82924998085946, "ttft_ms": 12.080707936547697, "decode_ms": 106.78008291870356}, "total_wall_ms": 37833.86616699863, "ttft_ms": 12.080707936547697, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 7075 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fb8baac8f08eb7f253855b90", "attempt_id": "7e86b02eb9a8", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.335315Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.19829202257097, "ttft_ms": 12.103290995582938, "decode_ms": 94.25379196181893}, "total_wall_ms": 37821.74595899414, "ttft_ms": 12.103290995582938, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828869", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c37a6a24f6b43a5a4c626354b69a44fd62c2a91de72daee7f63e18e6519e339c"} | ||||
| 7076 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f983dd5cc660adb3a0944dc3", "attempt_id": "3428f9ab3c0d", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.621764Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 439, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.37683296296746, "ttft_ms": 12.100375024601817, "decode_ms": 11.785792070440948}, "total_wall_ms": 37739.43362594582, "ttft_ms": 12.100375024601817, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7077 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5a3b938433b7325380210ba5", "attempt_id": "d16eade7a533", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.826294Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.18254102952778, "ttft_ms": 11.924582999199629, "decode_ms": 82.65087497420609}, "total_wall_ms": 37809.9230841035, "ttft_ms": 11.924582999199629, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 7078 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae97db2ca3bf2b857c0c4853", "attempt_id": "855320fc4edc", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:37.100907Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.13762497156858, "ttft_ms": 12.296458939090371, "decode_ms": 12.01220799703151}, "total_wall_ms": 37739.60337601602, "ttft_ms": 12.296458939090371, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7079 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e5f61921fb6e86702125797a", "attempt_id": "7806cd14f4fb", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:37.305026Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.32495789881796, "ttft_ms": 11.958708055317402, "decode_ms": 11.77216600626707}, "total_wall_ms": 37738.21370897349, "ttft_ms": 11.958708055317402, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7080 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2164eaf55adec160350afcea", "attempt_id": "4028e3ae5bf4", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:37.508467Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 434, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.11120800673962, "ttft_ms": 12.010792037472129, "decode_ms": 11.776332976296544}, "total_wall_ms": 37739.052542019635, "ttft_ms": 12.010792037472129, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7081 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecf378f18f83e91a4a2bb009", "attempt_id": "a840f58ffae3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:44.586850Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.39816696755588, "ttft_ms": 12.008749996311963, "decode_ms": 11.808292008936405}, "total_wall_ms": 7123.195458087139, "ttft_ms": 12.008749996311963, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7082 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3717a5487ca301c1b90e712a", "attempt_id": "18e238d8b598", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:44.854300Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.32675000932068, "ttft_ms": 12.204624945297837, "decode_ms": 141.75216702278703}, "total_wall_ms": 7253.243750077672, "ttft_ms": 12.204624945297837, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 7083 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f39015b7f4b92e8aadb79155", "attempt_id": "5821318a51f3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:45.251472Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.2632919009775, "ttft_ms": 12.079749954864383, "decode_ms": 82.49475003685802}, "total_wall_ms": 7193.786250078119, "ttft_ms": 12.079749954864383, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 7084 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89afbd65374758573e3bf235", "attempt_id": "993379ddccbd", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:45.589886Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.6386670526117, "ttft_ms": 12.205207953229547, "decode_ms": 107.5730420416221}, "total_wall_ms": 7219.407292082906, "ttft_ms": 12.205207953229547, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7085 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a6ceb38c7a36d3b76b121ce6", "attempt_id": "558191f219e4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:45.953968Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.708208094351, "ttft_ms": 12.044125003740191, "decode_ms": 11.885791085660458}, "total_wall_ms": 7123.605582979508, "ttft_ms": 12.044125003740191, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7086 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d55940ad814ea51f66aa670d", "attempt_id": "a0400bdb8e95", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:46.222757Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 227.11304191034287, "ttft_ms": 12.050083023495972, "decode_ms": 11.975583038292825}, "total_wall_ms": 7124.084834009409, "ttft_ms": 12.050083023495972, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7087 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5f64637debfcb3abed126c29", "attempt_id": "9d1ee3a7170e", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:46.490727Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.7370419576764, "ttft_ms": 12.006000033579767, "decode_ms": 11.910791974514723}, "total_wall_ms": 7123.604124994017, "ttft_ms": 12.006000033579767, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7088 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "00dcee01a631ac4074851cfd", "attempt_id": "ed9d5d16718b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:46.758253Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.4244999969378, "ttft_ms": 12.102290987968445, "decode_ms": 11.87124999705702}, "total_wall_ms": 7123.323500039987, "ttft_ms": 12.102290987968445, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 7089 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dff5d1c7f0b819f9c7b485ba", "attempt_id": "d5715475cd55", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:47.025362Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 228.43862499576062, "ttft_ms": 11.999665992334485, "decode_ms": 82.97087496612221}, "total_wall_ms": 7196.34866702836, "ttft_ms": 11.999665992334485, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 7090 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4d5374393eb6553718c49068", "attempt_id": "b5aa76e038db", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:47.366144Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 227.09895798470825, "ttft_ms": 12.103792047128081, "decode_ms": 106.72749998047948}, "total_wall_ms": 7218.880292028189, "ttft_ms": 12.103792047128081, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 7091 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dda8b0ccc53ee42e5fc7832f", "attempt_id": "891dc21a2a8e", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:47.729631Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 228.44483295921236, "ttft_ms": 12.022083974443376, "decode_ms": 82.89099996909499}, "total_wall_ms": 7196.3205829961225, "ttft_ms": 12.022083974443376, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 7092 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59f470b9d69dff39cae28df5", "attempt_id": "d64745a6af00", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.070402Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.62149998359382, "ttft_ms": 12.313459068536758, "decode_ms": 118.08500008191913}, "total_wall_ms": 7229.986250051297, "ttft_ms": 12.313459068536758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,077", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "2044d7c4afd32892ac22705680e35174db83308c139b02a1494275cc5e24aff3"} | ||||
| 7093 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7c9cca67d997a388d204358", "attempt_id": "d513539d765d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.444654Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.81825002655387, "ttft_ms": 11.991707957349718, "decode_ms": 11.848459020256996}, "total_wall_ms": 7123.618375044316, "ttft_ms": 11.991707957349718, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7094 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55e681c17db92b0fcb649758", "attempt_id": "93a9f185f633", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.712735Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.541250012815, "ttft_ms": 12.040166067890823, "decode_ms": 11.896249954588711}, "total_wall_ms": 7123.438459006138, "ttft_ms": 12.040166067890823, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7095 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3a2c56a8ebbc43adf3d95555", "attempt_id": "3e06879f4692", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.980309Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 227.02700004447252, "ttft_ms": 11.992000043392181, "decode_ms": 11.835499899461865}, "total_wall_ms": 7123.790000099689, "ttft_ms": 11.992000043392181, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7096 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "292f2d35ea7fc966ba58c3f3", "attempt_id": "5b0fd0a05039", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:54.292130Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 519, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.1570000629872, "ttft_ms": 11.686292011290789, "decode_ms": 11.701290961354971}, "total_wall_ms": 12148.171665961854, "ttft_ms": 11.686292011290789, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7097 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "429d9dd81e60b3d3340970fe", "attempt_id": "c3fe10eaf7c7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:54.542884Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 526, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.60116700734943, "ttft_ms": 11.759374989196658, "decode_ms": 114.80199999641627}, "total_wall_ms": 12251.792415976524, "ttft_ms": 11.759374989196658, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 7098 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3afedd96345ac9c9ea4879fa", "attempt_id": "e8c232196903", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:54.896436Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 525, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.69383302144706, "ttft_ms": 11.725250049494207, "decode_ms": 45.76870799064636}, "total_wall_ms": 12182.807583012618, "ttft_ms": 11.725250049494207, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 7099 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ec7e80efbd61a7c2cc8f41a2", "attempt_id": "5ae3f837d63c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:55.180655Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 521, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.19991703704, "ttft_ms": 11.640792014077306, "decode_ms": 103.30366692505777}, "total_wall_ms": 12239.772083004937, "ttft_ms": 11.640792014077306, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4bbc2899b863a572a5b9185e", "attempt_id": "02c13bf379fd", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:55.521554Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 532, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 210.0380000192672, "ttft_ms": 11.629624990746379, "decode_ms": 11.488749994896352}, "total_wall_ms": 12148.786542005837, "ttft_ms": 11.629624990746379, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ca5a2d032fdbe4fb5cd4d564", "attempt_id": "c422f312da6d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:55.771576Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 527, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.37150006648153, "ttft_ms": 11.71729201450944, "decode_ms": 11.523833964020014}, "total_wall_ms": 12148.233084008098, "ttft_ms": 11.71729201450944, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751968142b8b3167a2b7f5d4", "attempt_id": "bb63684a4bb5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.021535Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 521, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.30079196114093, "ttft_ms": 11.983166914433241, "decode_ms": 22.998959058895707}, "total_wall_ms": 12159.89487490151, "ttft_ms": 11.983166914433241, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 7103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d3935d5524047cfa8f9b2bf0", "attempt_id": "f11c6fb95282", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.282596Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 521, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.30437499191612, "ttft_ms": 11.904875049367547, "decode_ms": 22.978166001848876}, "total_wall_ms": 12159.794874954969, "ttft_ms": 11.904875049367547, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 7104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "72e3acf0e01234d3aeab6cee", "attempt_id": "99801e1fe749", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.544602Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 536, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.90879100281745, "ttft_ms": 11.64100004825741, "decode_ms": 57.76754196267575}, "total_wall_ms": 12194.930416997522, "ttft_ms": 11.64100004825741, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,010,205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "12facbb746e46f5872a48eea64f64dc2cbd9610b1548522078108253d03a7904"} | ||||
| 7105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "780c38ae1e7a859fb34e6815", "attempt_id": "1280f2628e32", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.840885Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 529, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.10687500145286, "ttft_ms": 11.756792082451284, "decode_ms": 57.42233304772526}, "total_wall_ms": 12193.888499983586, "ttft_ms": 11.756792082451284, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 7106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be639b2a148fb27410da43bb", "attempt_id": "5f0e4c640208", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:57.136256Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 537, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 210.32570803072304, "ttft_ms": 11.808958020992577, "decode_ms": 11.568875052034855}, "total_wall_ms": 12149.332833010703, "ttft_ms": 11.808958020992577, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ee4d154591dcac9396307c9e", "attempt_id": "2c4ed2618709", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:57.386562Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 532, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 210.01262497156858, "ttft_ms": 11.720290989615023, "decode_ms": 298.07845898903906}, "total_wall_ms": 12435.455665923655, "ttft_ms": 11.720290989615023, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937 + 1,787,610 + 8,278,225 = 16,980,772", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.4}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "c5fb5d9b76b7a02439f0acb83233430b95eef4aa96f8df88b9152c3b3e51343c"} | ||||
| 7108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8e0eb7bbee465867fbabf295", "attempt_id": "524a6272f179", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:57.924621Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 528, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.4906660495326, "ttft_ms": 11.656083050183952, "decode_ms": 11.460999958217144}, "total_wall_ms": 12148.191374959424, "ttft_ms": 11.656083050183952, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83b00003e3fa4b248f69e837", "attempt_id": "d716a71b2147", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:58.174663Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 532, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.80624994263053, "ttft_ms": 11.868958012200892, "decode_ms": 23.161166929639876}, "total_wall_ms": 12160.468666930683, "ttft_ms": 11.868958012200892, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 7110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "db09be4d7a69be2eb46431c3", "attempt_id": "f2e89c99e080", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:58.436190Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 534, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.62866698391736, "ttft_ms": 11.73908298369497, "decode_ms": 11.487790965475142}, "total_wall_ms": 12148.470208980143, "ttft_ms": 11.73908298369497, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dfabe703c66f3f8e1bd3d719", "attempt_id": "4861d6afec1b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:09.758074Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 490, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 206.24066703021526, "ttft_ms": 11.743957991711795, "decode_ms": 11.539915925823152}, "total_wall_ms": 23213.434666977264, "ttft_ms": 11.743957991711795, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e4e2f414adcf3890df45d844", "attempt_id": "79f5b35dc816", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.004910Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 497, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.9006660496816, "ttft_ms": 11.733249993994832, "decode_ms": 115.8215410541743}, "total_wall_ms": 23319.396708044223, "ttft_ms": 11.733249993994832, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 7113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a13b47f56009315605b80552", "attempt_id": "f8ddb8dd3241", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.357057Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 496, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 205.87050006724894, "ttft_ms": 11.806832975707948, "decode_ms": 46.47175001446158}, "total_wall_ms": 23248.114499961957, "ttft_ms": 11.806832975707948, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 7114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8626319698b2c2156c13f0a7", "attempt_id": "0baf19023d48", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.638756Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 206.41062501817942, "ttft_ms": 11.7896250449121, "decode_ms": 104.55258307047188}, "total_wall_ms": 23306.675791041926, "ttft_ms": 11.7896250449121, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a9c34da8bf935186ca88ad1b", "attempt_id": "14b5fe2801a6", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.978972Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 208.06566695682704, "ttft_ms": 11.687041958793998, "decode_ms": 11.644500074908137}, "total_wall_ms": 23215.29337496031, "ttft_ms": 11.687041958793998, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9dafde273e18c4ee3e7069eb", "attempt_id": "50f610781441", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.227879Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 498, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.67320797313005, "ttft_ms": 11.876165983267128, "decode_ms": 11.814334080554545}, "total_wall_ms": 23215.294416993856, "ttft_ms": 11.876165983267128, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aaa7a7add60ce5e11a1441e7", "attempt_id": "bba9fd272f81", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.476430Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 205.95729094929993, "ttft_ms": 11.706916033290327, "decode_ms": 23.29354197718203}, "total_wall_ms": 23224.83874997124, "ttft_ms": 11.706916033290327, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 7118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a7eac567267d564d1e795b39", "attempt_id": "f698f696c65b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.734874Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.91820797603577, "ttft_ms": 11.799959000200033, "decode_ms": 23.308750009164214}, "total_wall_ms": 23226.958292070776, "ttft_ms": 11.799959000200033, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 7119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8358207eadeb8126475457b5", "attempt_id": "74feeb97cfa4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.995903Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 507, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.12370902765542, "ttft_ms": 11.836000019684434, "decode_ms": 58.3128749858588}, "total_wall_ms": 23261.240166961215, "ttft_ms": 11.836000019684434, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,010,205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "12facbb746e46f5872a48eea64f64dc2cbd9610b1548522078108253d03a7904"} | ||||
| 7120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df29ce9d3ec2ca091c6a5f91", "attempt_id": "338bb16699d3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:12.291250Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 500, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 206.97824994567782, "ttft_ms": 11.8665830232203, "decode_ms": 58.1426250282675}, "total_wall_ms": 23260.930624906905, "ttft_ms": 11.8665830232203, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 7121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c5a9c203da8d3c85f53bee8c", "attempt_id": "ddeef272b1c2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:12.585910Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 508, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.73366698995233, "ttft_ms": 11.777165927924216, "decode_ms": 11.898291064426303}, "total_wall_ms": 23215.30525002163, "ttft_ms": 11.777165927924216, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df206db021827fbaf90b5d73", "attempt_id": "12a67fd78404", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:12.834295Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.91666698642075, "ttft_ms": 11.728040990419686, "decode_ms": 301.89700005576015}, "total_wall_ms": 23505.46812498942, "ttft_ms": 11.728040990419686, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937 + 1,787,610 + 8,278,225 = 16,980,772", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.4}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "c5fb5d9b76b7a02439f0acb83233430b95eef4aa96f8df88b9152c3b3e51343c"} | ||||
| 7123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a25e6f29980ac10c153c7c60", "attempt_id": "3441fa81c60f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:13.373097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 499, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.03924994450063, "ttft_ms": 11.80079102050513, "decode_ms": 11.682207928970456}, "total_wall_ms": 23214.439749950543, "ttft_ms": 11.80079102050513, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ab18cd59050673e42c6dbf5", "attempt_id": "c4501c8859f7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:13.620762Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 209.02758301235735, "ttft_ms": 11.82587502989918, "decode_ms": 11.626291903667152}, "total_wall_ms": 23216.419583070092, "ttft_ms": 11.82587502989918, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f865d1300eef0a30fee6d154", "attempt_id": "cdc13db857d0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:13.870869Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 505, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 208.67758302483708, "ttft_ms": 11.671332991681993, "decode_ms": 11.490499950014055}, "total_wall_ms": 23215.73445899412, "ttft_ms": 11.671332991681993, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5bea7e952ef3124857ebf1e5", "attempt_id": "2bab77b0c2af", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:35.766587Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 490, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.54070791695267, "ttft_ms": 11.606125044636428, "decode_ms": 11.500791064463556}, "total_wall_ms": 44853.72995806392, "ttft_ms": 11.606125044636428, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6d04997b4e7393c1c4d422f7", "attempt_id": "0ca8e559b3c2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.012329Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 497, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.6505000218749, "ttft_ms": 11.552124982699752, "decode_ms": 114.7153329802677}, "total_wall_ms": 44956.97683293838, "ttft_ms": 11.552124982699752, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 7128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5513ed92fbb9a62ad2e3e670", "attempt_id": "0b1358da766f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.360524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 496, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.58270800393075, "ttft_ms": 11.726291966624558, "decode_ms": 46.06037505436689}, "total_wall_ms": 44888.58349993825, "ttft_ms": 11.726291966624558, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 7129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "342492acda34dd62c8927c7a", "attempt_id": "82e71c2e27fb", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.640029Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.49395796842873, "ttft_ms": 11.706040939316154, "decode_ms": 103.56912505812943}, "total_wall_ms": 44945.98799897358, "ttft_ms": 11.706040939316154, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fb7b0cba5561957abf2f9e7d", "attempt_id": "ff7eb9ea83c8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.977139Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.89683295879513, "ttft_ms": 11.536833946593106, "decode_ms": 11.517417035065591}, "total_wall_ms": 44856.00374999922, "ttft_ms": 11.536833946593106, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ddae4fd2ea0f6622042da8a1", "attempt_id": "923a18f829ab", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.225005Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 498, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 206.6919170320034, "ttft_ms": 11.615708004683256, "decode_ms": 11.492042103782296}, "total_wall_ms": 44854.840541025624, "ttft_ms": 11.615708004683256, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e99444682b2647a9d1f225ef", "attempt_id": "1dc4f37b0538", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.470529Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 206.48579101543874, "ttft_ms": 11.523665976710618, "decode_ms": 22.95541705098003}, "total_wall_ms": 44865.99916697014, "ttft_ms": 11.523665976710618, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 7133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c82159bb6d1b2693879010ce", "attempt_id": "9cfc68fe24a1", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.727520Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.37658303510398, "ttft_ms": 11.629833024926484, "decode_ms": 23.068250040523708}, "total_wall_ms": 44865.222748951055, "ttft_ms": 11.629833024926484, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 7134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a2a8eaa3f395a27f4ab5cedd", "attempt_id": "75fe32a71ebd", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.983494Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 507, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.95070903841406, "ttft_ms": 11.485417024232447, "decode_ms": 57.63437494169921}, "total_wall_ms": 44902.11654105224, "ttft_ms": 11.485417024232447, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,010,205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "12facbb746e46f5872a48eea64f64dc2cbd9610b1548522078108253d03a7904"} | ||||
| 7135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6f5cf23ff573451d905002c2", "attempt_id": "a49aebdd83cb", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:38.276726Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 500, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 206.10175002366304, "ttft_ms": 11.502541950903833, "decode_ms": 57.40062496624887}, "total_wall_ms": 44900.05395794287, "ttft_ms": 11.502541950903833, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 7136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0660a5cf6123369c78d0112f", "attempt_id": "b83f846951b2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:38.567754Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 508, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 208.3208749536425, "ttft_ms": 11.555084027349949, "decode_ms": 11.706332908943295}, "total_wall_ms": 44856.603916035965, "ttft_ms": 11.555084027349949, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ff8a9e150f4804461a35ecf", "attempt_id": "944d46eb4f12", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:38.815297Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 208.48258293699473, "ttft_ms": 11.795250000432134, "decode_ms": 298.95991703961045}, "total_wall_ms": 45144.31745803449, "ttft_ms": 11.795250000432134, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937 + 1,787,610 + 8,278,225 = 16,980,772", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.4}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "c5fb5d9b76b7a02439f0acb83233430b95eef4aa96f8df88b9152c3b3e51343c"} | ||||
| 7138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "74e98c76a3302f7e1645398b", "attempt_id": "730775e135cc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:39.350078Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 499, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.86812505684793, "ttft_ms": 11.652125045657158, "decode_ms": 11.538667022250593}, "total_wall_ms": 44856.26437398605, "ttft_ms": 11.652125045657158, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "30ef5b3e969734698441069d", "attempt_id": "d2f6f26e05e1", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:39.597157Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 208.42470810748637, "ttft_ms": 11.685249977745116, "decode_ms": 11.51199999731034}, "total_wall_ms": 44856.84912500437, "ttft_ms": 11.685249977745116, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "25715c96bfa5e7120815644e", "attempt_id": "c8b533206d63", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:39.845092Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 505, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.27558399084955, "ttft_ms": 11.788583011366427, "decode_ms": 11.573042022064328}, "total_wall_ms": 44855.82375002559, "ttft_ms": 11.788583011366427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5b8ad3e54d8c46a7a3708aaf", "attempt_id": "dfd63c4ee7a1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:46.997516Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 411, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.03166695777327, "ttft_ms": 11.918416945263743, "decode_ms": 11.814957950264215}, "total_wall_ms": 7088.69258291088, "ttft_ms": 11.918416945263743, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "25c983ff6d01a61fd9bc3a10", "attempt_id": "82a6c4a15660", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.200062Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 418, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.37533295154572, "ttft_ms": 11.79183297790587, "decode_ms": 11.748916003853083}, "total_wall_ms": 7089.861541986465, "ttft_ms": 11.79183297790587, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e666bc2522ce9a46111cef56", "attempt_id": "914b684296ff", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.403041Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 417, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.71820897236466, "ttft_ms": 11.816457961685956, "decode_ms": 11.783291003666818}, "total_wall_ms": 7089.226332958788, "ttft_ms": 11.816457961685956, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c99549ec9e7f764bfd39fcae", "attempt_id": "82c1267cbf76", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.605341Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.0434580836445, "ttft_ms": 11.916000046767294, "decode_ms": 106.1162919504568}, "total_wall_ms": 7183.022542041726, "ttft_ms": 11.916000046767294, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e30614e72986a0e897a531b7", "attempt_id": "c0ddc23ab826", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.901315Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.66183292120695, "ttft_ms": 11.917000054381788, "decode_ms": 11.772415949963033}, "total_wall_ms": 7090.299208997749, "ttft_ms": 11.917000054381788, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "809760b2e49d08da3c32504f", "attempt_id": "bc6711c52254", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.104427Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.67008304223418, "ttft_ms": 11.832458898425102, "decode_ms": 117.6555419806391}, "total_wall_ms": 7196.079499903135, "ttft_ms": 11.832458898425102, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 7147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "91115ee512e65260a24be95a", "attempt_id": "11bcf2b8f656", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.413022Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.16120903845876, "ttft_ms": 11.766124982386827, "decode_ms": 11.783291003666818}, "total_wall_ms": 7088.605041964911, "ttft_ms": 11.766124982386827, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3f4d8191f8a1a79816532c58", "attempt_id": "b46fb5cfe4cc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.614653Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 413, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.3319589998573, "ttft_ms": 11.778834043070674, "decode_ms": 11.786999995820224}, "total_wall_ms": 7088.82975007873, "ttft_ms": 11.778834043070674, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e55da20ffcdcfedbbd152b0f", "attempt_id": "20baf1b80cb6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.816194Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.74241700395942, "ttft_ms": 11.76379097159952, "decode_ms": 105.97279097419232}, "total_wall_ms": 7184.409208944999, "ttft_ms": 11.76379097159952, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 7150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36267248c59b4bf66952492c", "attempt_id": "2d803970785d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.113299Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.74362504575402, "ttft_ms": 11.74829201772809, "decode_ms": 94.459000043571}, "total_wall_ms": 7172.85324994009, "ttft_ms": 11.74829201772809, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | ||||
| 7151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "455749589724001613fb9977", "attempt_id": "edf9e1a9d292", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.398808Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 430, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.61391602549702, "ttft_ms": 11.799250030890107, "decode_ms": 11.838750098831952}, "total_wall_ms": 7090.168667025864, "ttft_ms": 11.799250030890107, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "930fdfaeba90af289a75cb42", "attempt_id": "210167b42167", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.601819Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.16475009080023, "ttft_ms": 12.144459062255919, "decode_ms": 82.49591593630612}, "total_wall_ms": 7160.804915940389, "ttft_ms": 12.144459062255919, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 7153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c83c1e1d1b2d5fc9ed136f8b", "attempt_id": "b24ebe69d32d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.875452Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.4248330956325, "ttft_ms": 11.745458003133535, "decode_ms": 11.822083033621311}, "total_wall_ms": 7089.925166917965, "ttft_ms": 11.745458003133535, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a413e661e3f29a3499aa4cef", "attempt_id": "14096fe6c9a7", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:50.078611Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.6319580245763, "ttft_ms": 12.003249954432249, "decode_ms": 11.87183300498873}, "total_wall_ms": 7089.54525005538, "ttft_ms": 12.003249954432249, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7d67252d68708916ce139c40", "attempt_id": "8b7a0833495b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:50.281170Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 425, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.75304199755192, "ttft_ms": 11.849457980133593, "decode_ms": 11.84250006917864}, "total_wall_ms": 7090.372124919668, "ttft_ms": 11.849457980133593, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "32f0aea542e323974c082c53", "attempt_id": "56b00936af11", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.207317Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 401, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.11791701894253, "ttft_ms": 11.538624996319413, "decode_ms": 11.575874988920987}, "total_wall_ms": 10832.374625024386, "ttft_ms": 11.538624996319413, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "52e00003bf89a2dd0db49ee0", "attempt_id": "6c3e2fed0be6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.432105Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 408, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 187.07454099785537, "ttft_ms": 11.601374950259924, "decode_ms": 11.515165911987424}, "total_wall_ms": 10834.40662396606, "ttft_ms": 11.601374950259924, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "076477e095094cf954531adc", "attempt_id": "6feeefafeacf", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.658401Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 407, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.49241696018726, "ttft_ms": 11.523708933964372, "decode_ms": 11.476584011688828}, "total_wall_ms": 10832.613540929742, "ttft_ms": 11.523708933964372, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80df95069eef4bba0c71069b", "attempt_id": "9441a5d15ba2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.883030Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 403, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.39558397606015, "ttft_ms": 11.498625040985644, "decode_ms": 103.44258300028741}, "total_wall_ms": 10924.560333020054, "ttft_ms": 11.498625040985644, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f7ef7c35ce0bb2b23a36107c", "attempt_id": "f85e1169a0c5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.198965Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 414, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 182.9623329686001, "ttft_ms": 11.450292076915503, "decode_ms": 11.449708021245897}, "total_wall_ms": 10829.991040984169, "ttft_ms": 11.450292076915503, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "47ba67bdea77540ff06ab780", "attempt_id": "ca09a65cbbf2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.420757Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 409, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 183.7443329859525, "ttft_ms": 11.527374968864024, "decode_ms": 11.427958030253649}, "total_wall_ms": 10830.80004202202, "ttft_ms": 11.527374968864024, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b341bb9b289354fbbef778a0", "attempt_id": "efc9f2707e87", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.642982Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 403, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.20104193501174, "ttft_ms": 11.518582934513688, "decode_ms": 11.543250060640275}, "total_wall_ms": 10831.360082956962, "ttft_ms": 11.518582934513688, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "808fe4967e57b1088dbbd2fb", "attempt_id": "ff20fe126819", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.865367Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 403, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 186.58191699068993, "ttft_ms": 11.780000058934093, "decode_ms": 11.600499972701073}, "total_wall_ms": 10834.17795796413, "ttft_ms": 11.780000058934093, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 7164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f3fc6c39901c8b347be8d999", "attempt_id": "f48ff9ebe6c6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.090508Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 418, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.23929205164313, "ttft_ms": 11.577625060454011, "decode_ms": 57.389084016904235}, "total_wall_ms": 10877.343916916288, "ttft_ms": 11.577625060454011, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 7165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0fd7e8fcf4255c723aee3f42", "attempt_id": "271530ae39d2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.359377Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 411, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 187.27079196833074, "ttft_ms": 11.509082978591323, "decode_ms": 57.34191706869751}, "total_wall_ms": 10880.241040955298, "ttft_ms": 11.509082978591323, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,000,000", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "a8f19157bfa97ae9789ef71ec65944fe20e98491b7b0c2aa047d68bf92a3e7fd"} | ||||
| 7166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "301fe2a9b9d7f0292e06b499", "attempt_id": "29911531c148", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.630954Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 419, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 181.3983329338953, "ttft_ms": 11.585332918912172, "decode_ms": 11.511708959005773}, "total_wall_ms": 10828.584041912109, "ttft_ms": 11.585332918912172, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d7600423fe9bb67750d9c6eb", "attempt_id": "736405ccda0f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.851089Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 414, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.55691705457866, "ttft_ms": 11.523167020641267, "decode_ms": 57.48795799445361}, "total_wall_ms": 10877.674916875549, "ttft_ms": 11.523167020641267, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 7168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d8a893b6b7b40dcd1750232b", "attempt_id": "087350c8c1a0", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:57.120063Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 410, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.09566702414304, "ttft_ms": 11.490083066746593, "decode_ms": 11.453374987468123}, "total_wall_ms": 10832.114374963567, "ttft_ms": 11.490083066746593, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e26ea3805eb9a9309fe7295b", "attempt_id": "f92eeca785e2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:57.343543Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 414, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.01579197961837, "ttft_ms": 11.505834059789777, "decode_ms": 11.486624949611723}, "total_wall_ms": 10831.102123949677, "ttft_ms": 11.505834059789777, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b7d6b742cbb2bab36003ae9", "attempt_id": "90cb0f935966", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:57.565991Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 416, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 186.47879210766405, "ttft_ms": 11.604208033531904, "decode_ms": 11.550666997209191}, "total_wall_ms": 10833.764332928695, "ttft_ms": 11.604208033531904, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "282648cc1ad692181a94033b", "attempt_id": "f3a7c9017338", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.145574Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 427, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.1518328981474, "ttft_ms": 11.601875070482492, "decode_ms": 11.466708034276962}, "total_wall_ms": 19182.455581845716, "ttft_ms": 11.601875070482492, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2efd215d6f379713b19ef1c5", "attempt_id": "aac35836d7d5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.368425Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 434, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.1881669824943, "ttft_ms": 11.533332988619804, "decode_ms": 11.421707924455404}, "total_wall_ms": 19183.356457855552, "ttft_ms": 11.533332988619804, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a199f98122c4ea0436580d6e", "attempt_id": "b61ed8163389", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.591094Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 433, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.53512499015778, "ttft_ms": 11.808916926383972, "decode_ms": 11.57833298202604}, "total_wall_ms": 19183.29666578211, "ttft_ms": 11.808916926383972, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea875e8491bf9ad2111e80b0", "attempt_id": "a2079ddcb751", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.814222Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.72191698290408, "ttft_ms": 11.70645805541426, "decode_ms": 103.66066603455693}, "total_wall_ms": 19275.43687389698, "ttft_ms": 11.70645805541426, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d1146bf9fbcb72926ca626e1", "attempt_id": "e942b88622b5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.130065Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.64200000744313, "ttft_ms": 11.569666909053922, "decode_ms": 11.474541970528662}, "total_wall_ms": 19183.910374878906, "ttft_ms": 11.569666909053922, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c424cebb58afa5480b073e7a", "attempt_id": "8dbcf864c9ef", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.353743Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 435, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.20074989646673, "ttft_ms": 11.636749957688153, "decode_ms": 11.452458100393414}, "total_wall_ms": 19184.493873850442, "ttft_ms": 11.636749957688153, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0cf9fa8bf456be126d1a70ac", "attempt_id": "5bf132d61906", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.577705Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.41195897664875, "ttft_ms": 11.66979200206697, "decode_ms": 11.54587499331683}, "total_wall_ms": 19182.796790846623, "ttft_ms": 11.66979200206697, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "877dbce9aad6b105b61fbc39", "attempt_id": "7e1897b6ffb6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.799523Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.62191596720368, "ttft_ms": 11.542417109012604, "decode_ms": 11.489874916151166}, "total_wall_ms": 19184.848331846297, "ttft_ms": 11.542417109012604, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 7179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9bf21bf5e9cd7b14dbf52c10", "attempt_id": "0a036e322eb1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.023148Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 444, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.39075001515448, "ttft_ms": 11.536792037077248, "decode_ms": 57.62087507173419}, "total_wall_ms": 19229.782623820938, "ttft_ms": 11.536792037077248, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 7180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4991735f0c6d669ddb410cc9", "attempt_id": "8c0d7c661a06", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.292353Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 437, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.92350000794977, "ttft_ms": 11.530791060067713, "decode_ms": 57.63629195280373}, "total_wall_ms": 19229.3029158609, "ttft_ms": 11.530791060067713, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,000,000", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "a8f19157bfa97ae9789ef71ec65944fe20e98491b7b0c2aa047d68bf92a3e7fd"} | ||||
| 7181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c47c24168ce645996e58b291", "attempt_id": "46f84613dd6d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.561144Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 445, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.29229098930955, "ttft_ms": 11.526333983056247, "decode_ms": 11.494959006085992}, "total_wall_ms": 19184.505624813028, "ttft_ms": 11.526333983056247, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6393fcd54e83bd5591ea952e", "attempt_id": "b729ecb000cf", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.784875Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.37124998308718, "ttft_ms": 11.541667045094073, "decode_ms": 57.602541986852884}, "total_wall_ms": 19229.72504084464, "ttft_ms": 11.541667045094073, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 7183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a916e02221f5f654f3ea10a", "attempt_id": "773b8ba96a14", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:09.054030Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 436, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.26408297475427, "ttft_ms": 11.60491700284183, "decode_ms": 11.488249991089106}, "total_wall_ms": 19184.685706859455, "ttft_ms": 11.60491700284183, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fabb394ca93a9fb5207b7189", "attempt_id": "a9469949540a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:09.278464Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.82229195069522, "ttft_ms": 11.583750019781291, "decode_ms": 11.56625000294298}, "total_wall_ms": 19184.16024884209, "ttft_ms": 11.583750019781291, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "13d5741a3d04d8a6501b3f92", "attempt_id": "e7f662333103", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:09.502472Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 442, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.81195799540728, "ttft_ms": 11.778416926972568, "decode_ms": 11.68158301152289}, "total_wall_ms": 19184.613832854666, "ttft_ms": 11.778416926972568, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "986b57137b9ce8fe0a232066", "attempt_id": "70d8121f81eb", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.075314Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 427, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 182.95579100959003, "ttft_ms": 11.527625028975308, "decode_ms": 11.49016700219363}, "total_wall_ms": 36526.62808180321, "ttft_ms": 11.527625028975308, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "68fc80b4320f08c4739af3c0", "attempt_id": "a65a82a1bf8f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.297865Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 434, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 182.6196250040084, "ttft_ms": 11.574708973057568, "decode_ms": 11.532500036992133}, "total_wall_ms": 36526.34958282579, "ttft_ms": 11.574708973057568, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "af761bf2968d73dc291319e3", "attempt_id": "d4da182e198a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.519735Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 433, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.0052910372615, "ttft_ms": 11.547958012670279, "decode_ms": 11.56937493942678}, "total_wall_ms": 36526.74520784058, "ttft_ms": 11.547958012670279, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "31f6324d4005a81bb6e87b23", "attempt_id": "f5958669933b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.742047Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.25354093778878, "ttft_ms": 11.528333998285234, "decode_ms": 103.85308298282325}, "total_wall_ms": 36620.2802908374, "ttft_ms": 11.528333998285234, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 7190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a23ad7ecff07967e17a704de", "attempt_id": "20564f11cdaa", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.057282Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.3003750545904, "ttft_ms": 11.527125025168061, "decode_ms": 11.529542040079832}, "total_wall_ms": 36527.97053998802, "ttft_ms": 11.527125025168061, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0030acdb6dbf81d0d87ea3c8", "attempt_id": "aff3b9c61732", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.280243Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 435, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 186.0141250072047, "ttft_ms": 11.580625083297491, "decode_ms": 11.531542055308819}, "total_wall_ms": 36529.73383292556, "ttft_ms": 11.580625083297491, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3c1b90a9dc1fe77b57325b3f", "attempt_id": "de5809ce296a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.505046Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.01004194654524, "ttft_ms": 11.83879200834781, "decode_ms": 11.49150007404387}, "total_wall_ms": 36526.95266494993, "ttft_ms": 11.83879200834781, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "702bd4b1cb5dcffaa41e0b10", "attempt_id": "e37327299fcf", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.726653Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.0625410657376, "ttft_ms": 11.526082991622388, "decode_ms": 11.536041973158717}, "total_wall_ms": 36526.72833192628, "ttft_ms": 11.526082991622388, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 7194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f42418df841e1cee7a2ba592", "attempt_id": "41382625009e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.947685Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 444, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.81733393855393, "ttft_ms": 11.634916998445988, "decode_ms": 57.519542053341866}, "total_wall_ms": 36574.61024890654, "ttft_ms": 11.634916998445988, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 7195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9ff142be453fac0f188c51ee", "attempt_id": "6a004181a6b0", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.216944Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 437, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.62754203937948, "ttft_ms": 11.469374992884696, "decode_ms": 57.3348329635337}, "total_wall_ms": 36574.054081807844, "ttft_ms": 11.469374992884696, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,000,000", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "a8f19157bfa97ae9789ef71ec65944fe20e98491b7b0c2aa047d68bf92a3e7fd"} | ||||
| 7196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da71969e078df5a4d0ace118", "attempt_id": "95f02332134a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.485706Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 445, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.98929201066494, "ttft_ms": 11.605625040829182, "decode_ms": 11.454334016889334}, "total_wall_ms": 36527.655539801344, "ttft_ms": 11.605625040829182, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "523abb46c407a1c204e938ad", "attempt_id": "552d6ea44f3e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.709208Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 185.88920799084008, "ttft_ms": 11.528583010658622, "decode_ms": 57.80966591555625}, "total_wall_ms": 36575.850290828384, "ttft_ms": 11.528583010658622, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 7198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "42189f91a606656db2179f32", "attempt_id": "b61e496c6038", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.980312Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 436, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.3075419999659, "ttft_ms": 11.470124940387905, "decode_ms": 11.47279201541096}, "total_wall_ms": 36526.87003987376, "ttft_ms": 11.470124940387905, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c33c52f5ed4bda6114c830fb", "attempt_id": "d864585fea94", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:30.202414Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.77762502152473, "ttft_ms": 11.464999988675117, "decode_ms": 11.751624988391995}, "total_wall_ms": 36528.57462386601, "ttft_ms": 11.464999988675117, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 7200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0e6ff093389e04dd8275310", "attempt_id": "2c20470b933f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:30.425778Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 442, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.4474999923259, "ttft_ms": 11.52937498409301, "decode_ms": 11.499374988488853}, "total_wall_ms": 36527.099415892735, "ttft_ms": 11.52937498409301, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
modified
runs/raw/E5_core.jsonl
+556 −0
@@ -1042,3 +1042,559 @@ | |||||
| 1042 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3bfe27a26779ce19f594bec1", "attempt_id": "1f845244c402", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "d40b392c23efff803ea24b0c3a963a6e8aab4a32", "timestamp_utc": "2026-10-30T08:23:27.630435Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6189, "message_tokens": 6103, "message_utf8_bytes": 30078, "cache_tensor_bytes": null, "serialized_payload_bytes": 30078, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03758410457521677, "ttft_ms": 14.184083906002343, "decode_ms": 153.4824169939384, "receiver_prefill_ms": 723.0160420294851}, "total_wall_ms": 900.3609180217609, "ttft_ms": 14.184083906002343, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-64S-4555", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f954bc741458afc161d3b4a4fb4f7fe52425f5f508bb1d60133554fadf04a6fd", "output_hash": "f6f8ca3da45dc6c01a3dede99eab98f0f3fd2d2c5e105791d9c68c607877ed22"} | 1042 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3bfe27a26779ce19f594bec1", "attempt_id": "1f845244c402", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "d40b392c23efff803ea24b0c3a963a6e8aab4a32", "timestamp_utc": "2026-10-30T08:23:27.630435Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6189, "message_tokens": 6103, "message_utf8_bytes": 30078, "cache_tensor_bytes": null, "serialized_payload_bytes": 30078, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03758410457521677, "ttft_ms": 14.184083906002343, "decode_ms": 153.4824169939384, "receiver_prefill_ms": 723.0160420294851}, "total_wall_ms": 900.3609180217609, "ttft_ms": 14.184083906002343, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-64S-4555", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f954bc741458afc161d3b4a4fb4f7fe52425f5f508bb1d60133554fadf04a6fd", "output_hash": "f6f8ca3da45dc6c01a3dede99eab98f0f3fd2d2c5e105791d9c68c607877ed22"} | ||
| 1043 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b03db8c230d582c85d299eda", "attempt_id": "b27fa85d9d16", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "d40b392c23efff803ea24b0c3a963a6e8aab4a32", "timestamp_utc": "2026-10-30T08:23:28.547567Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6195, "message_tokens": 6103, "message_utf8_bytes": 30078, "cache_tensor_bytes": null, "serialized_payload_bytes": 30078, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03758410457521677, "ttft_ms": 13.973666005767882, "decode_ms": 98.60866703093052, "receiver_prefill_ms": 722.3557910183445}, "total_wall_ms": 844.4480841280892, "ttft_ms": 13.973666005767882, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8859765", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f954bc741458afc161d3b4a4fb4f7fe52425f5f508bb1d60133554fadf04a6fd", "output_hash": "8d800485162553e438ca8ddff7de5613a4800ab0aeecee4f411e1cec8e2008bd"} | 1043 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b03db8c230d582c85d299eda", "attempt_id": "b27fa85d9d16", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "d40b392c23efff803ea24b0c3a963a6e8aab4a32", "timestamp_utc": "2026-10-30T08:23:28.547567Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6195, "message_tokens": 6103, "message_utf8_bytes": 30078, "cache_tensor_bytes": null, "serialized_payload_bytes": 30078, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03758410457521677, "ttft_ms": 13.973666005767882, "decode_ms": 98.60866703093052, "receiver_prefill_ms": 722.3557910183445}, "total_wall_ms": 844.4480841280892, "ttft_ms": 13.973666005767882, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8859765", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f954bc741458afc161d3b4a4fb4f7fe52425f5f508bb1d60133554fadf04a6fd", "output_hash": "8d800485162553e438ca8ddff7de5613a4800ab0aeecee4f411e1cec8e2008bd"} | ||
| 1044 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "33e419a36fc3b9901bd135ab", "attempt_id": "a3348a9cf0cb", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "d40b392c23efff803ea24b0c3a963a6e8aab4a32", "timestamp_utc": "2026-10-30T08:23:29.408628Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6190, "message_tokens": 6103, "message_utf8_bytes": 30078, "cache_tensor_bytes": null, "serialized_payload_bytes": 30078, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03758410457521677, "ttft_ms": 13.830917072482407, "decode_ms": 97.2098329802975, "receiver_prefill_ms": 723.0467500630766}, "total_wall_ms": 843.7343341065571, "ttft_ms": 13.830917072482407, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7730705", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f954bc741458afc161d3b4a4fb4f7fe52425f5f508bb1d60133554fadf04a6fd", "output_hash": "6c885473fb45b44c6a425cd3cd307b4771e35351a0e2c17186a92d2de9c1fd42"} | 1044 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "33e419a36fc3b9901bd135ab", "attempt_id": "a3348a9cf0cb", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "d40b392c23efff803ea24b0c3a963a6e8aab4a32", "timestamp_utc": "2026-10-30T08:23:29.408628Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6190, "message_tokens": 6103, "message_utf8_bytes": 30078, "cache_tensor_bytes": null, "serialized_payload_bytes": 30078, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03758410457521677, "ttft_ms": 13.830917072482407, "decode_ms": 97.2098329802975, "receiver_prefill_ms": 723.0467500630766}, "total_wall_ms": 843.7343341065571, "ttft_ms": 13.830917072482407, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7730705", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f954bc741458afc161d3b4a4fb4f7fe52425f5f508bb1d60133554fadf04a6fd", "output_hash": "6c885473fb45b44c6a425cd3cd307b4771e35351a0e2c17186a92d2de9c1fd42"} | ||
| 1045 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "dbcc69e60cc946c1c4925859", "attempt_id": "909282747386", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "d40b392c23efff803ea24b0c3a963a6e8aab4a32", "timestamp_utc": "2026-10-30T08:23:30.268946Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6198, "message_tokens": 6103, "message_utf8_bytes": 30078, "cache_tensor_bytes": null, "serialized_payload_bytes": 30078, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03758410457521677, "ttft_ms": 13.933582929894328, "decode_ms": 69.48795798234642, "receiver_prefill_ms": 723.6029580235481}, "total_wall_ms": 816.8121670605615, "ttft_ms": 13.933582929894328, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ixbanruk-3", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f954bc741458afc161d3b4a4fb4f7fe52425f5f508bb1d60133554fadf04a6fd", "output_hash": "1cc74509d5485de66115e1f6b591a4a84f89826fbba3b26cfbf7cfcfdc216bf5"} | ||||
| 1046 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "88acb85ee9df5a9f985a5548", "attempt_id": "082b381aa6f4", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:23:31.102452Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6192, "message_tokens": 6103, "message_utf8_bytes": 30078, "cache_tensor_bytes": null, "serialized_payload_bytes": 30078, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03758410457521677, "ttft_ms": 13.669125037267804, "decode_ms": 137.16050004586577, "receiver_prefill_ms": 723.7758749397472}, "total_wall_ms": 884.1153340181336, "ttft_ms": 13.669125037267804, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20,478,689", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f954bc741458afc161d3b4a4fb4f7fe52425f5f508bb1d60133554fadf04a6fd", "output_hash": "7b80aa4c363cfa59614b01d8fefd3b391f7a82483164746113ad4f4da7e7497f"} | ||||
| 1047 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9bc6680b620c8ca1bfd6d7d1", "attempt_id": "c0fd4e62409d", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:23:32.003243Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6193, "message_tokens": 6103, "message_utf8_bytes": 30078, "cache_tensor_bytes": null, "serialized_payload_bytes": 30078, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03758410457521677, "ttft_ms": 13.773542013950646, "decode_ms": 13.767624972388148, "receiver_prefill_ms": 735.2882920531556}, "total_wall_ms": 772.2675011027604, "ttft_ms": 13.773542013950646, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f954bc741458afc161d3b4a4fb4f7fe52425f5f508bb1d60133554fadf04a6fd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1048 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "249919015871075346a00791", "attempt_id": "dddb0fa11a8c", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:23:32.792822Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6194, "message_tokens": 6103, "message_utf8_bytes": 30078, "cache_tensor_bytes": null, "serialized_payload_bytes": 30078, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03758410457521677, "ttft_ms": 14.056417043320835, "decode_ms": 14.182667015120387, "receiver_prefill_ms": 749.0845830179751}, "total_wall_ms": 786.9983341079205, "ttft_ms": 14.056417043320835, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f954bc741458afc161d3b4a4fb4f7fe52425f5f508bb1d60133554fadf04a6fd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1049 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "fd1d66941740eeaf2778b092", "attempt_id": "b237860d0d9d", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:23:48.187681Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1123, "message_tokens": 1037, "message_utf8_bytes": 2613, "cache_tensor_bytes": null, "serialized_payload_bytes": 2613, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14590.413291938603, "ttft_ms": 13.471833080984652, "decode_ms": 120.94187503680587, "receiver_prefill_ms": 121.619459008798}, "total_wall_ms": 14853.483874932863, "ttft_ms": 13.471833080984652, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,544,550", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9eb44ba658f639bdbaf1826fa289b0eb2817b44d395237da065f5be90c480044", "output_hash": "275c8abab9d6375639c672e5391f7a9637810a7c2d3985510d6d956c3cb3a509"} | ||||
| 1050 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f7200a0ddfc418bed4fd88f7", "attempt_id": "101248486af3", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:23:48.469133Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1125, "message_tokens": 1037, "message_utf8_bytes": 2613, "cache_tensor_bytes": null, "serialized_payload_bytes": 2613, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14590.413291938603, "ttft_ms": 13.41891591437161, "decode_ms": 146.8593750614673, "receiver_prefill_ms": 120.86083402391523}, "total_wall_ms": 14873.448999947868, "ttft_ms": 13.41891591437161, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-64S-4555", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9eb44ba658f639bdbaf1826fa289b0eb2817b44d395237da065f5be90c480044", "output_hash": "f6f8ca3da45dc6c01a3dede99eab98f0f3fd2d2c5e105791d9c68c607877ed22"} | ||||
| 1051 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e13eec89371d8d87d13805eb", "attempt_id": "0597df357773", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:23:48.770133Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1131, "message_tokens": 1037, "message_utf8_bytes": 2613, "cache_tensor_bytes": null, "serialized_payload_bytes": 2613, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14590.413291938603, "ttft_ms": 13.578584068454802, "decode_ms": 93.96445902530104, "receiver_prefill_ms": 121.40875007025898}, "total_wall_ms": 14821.288750972599, "ttft_ms": 13.578584068454802, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8859765", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9eb44ba658f639bdbaf1826fa289b0eb2817b44d395237da065f5be90c480044", "output_hash": "8d800485162553e438ca8ddff7de5613a4800ab0aeecee4f411e1cec8e2008bd"} | ||||
| 1052 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0c18c6e728c6386a37e57be8", "attempt_id": "8fe01769ff13", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:23:49.018004Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1126, "message_tokens": 1037, "message_utf8_bytes": 2613, "cache_tensor_bytes": null, "serialized_payload_bytes": 2613, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14590.413291938603, "ttft_ms": 13.435499975457788, "decode_ms": 93.9098340459168, "receiver_prefill_ms": 121.61587504670024}, "total_wall_ms": 14821.260124910623, "ttft_ms": 13.435499975457788, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9781740", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9eb44ba658f639bdbaf1826fa289b0eb2817b44d395237da065f5be90c480044", "output_hash": "8b57ccd1ed84757887221612d34399545b6be9ebd8480805f7c2b5ffaa4dea1c"} | ||||
| 1053 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1403e7d54e48b4591b1d0e4b", "attempt_id": "4e0dfe60abff", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:23:49.266277Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1134, "message_tokens": 1037, "message_utf8_bytes": 2613, "cache_tensor_bytes": null, "serialized_payload_bytes": 2613, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14590.413291938603, "ttft_ms": 13.573667034506798, "decode_ms": 67.13166704867035, "receiver_prefill_ms": 121.31224991753697}, "total_wall_ms": 14794.301833957434, "ttft_ms": 13.573667034506798, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ixbanruk-3", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9eb44ba658f639bdbaf1826fa289b0eb2817b44d395237da065f5be90c480044", "output_hash": "1cc74509d5485de66115e1f6b591a4a84f89826fbba3b26cfbf7cfcfdc216bf5"} | ||||
| 1054 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "275befd3f80b78ad0a685ec9", "attempt_id": "cdc0cb1ad4dd", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:23:49.487660Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1128, "message_tokens": 1037, "message_utf8_bytes": 2613, "cache_tensor_bytes": null, "serialized_payload_bytes": 2613, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14590.413291938603, "ttft_ms": 13.37075000628829, "decode_ms": 107.46566706802696, "receiver_prefill_ms": 121.50362506508827}, "total_wall_ms": 14834.61320900824, "ttft_ms": 13.37075000628829, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20458969", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9eb44ba658f639bdbaf1826fa289b0eb2817b44d395237da065f5be90c480044", "output_hash": "7756e3d6c27c609ae9b5d5d8e4846e6ce5ce0ce61feccfe4eca30350985c4dd7"} | ||||
| 1055 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "fe28b7299176a54d413f13f0", "attempt_id": "3d828d1f0034", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:23:49.749143Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1129, "message_tokens": 1037, "message_utf8_bytes": 2613, "cache_tensor_bytes": null, "serialized_payload_bytes": 2613, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14590.413291938603, "ttft_ms": 13.388750026933849, "decode_ms": 13.4045829763636, "receiver_prefill_ms": 121.25162500888109}, "total_wall_ms": 14740.30895892065, "ttft_ms": 13.388750026933849, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9eb44ba658f639bdbaf1826fa289b0eb2817b44d395237da065f5be90c480044", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1056 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f5ea8c2e92bd225fe988f7f4", "attempt_id": "5a9a72c9d8b1", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:23:49.915803Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1130, "message_tokens": 1037, "message_utf8_bytes": 2613, "cache_tensor_bytes": null, "serialized_payload_bytes": 2613, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14590.413291938603, "ttft_ms": 13.584292028099298, "decode_ms": 13.418916962109506, "receiver_prefill_ms": 121.12466595135629}, "total_wall_ms": 14740.360624855384, "ttft_ms": 13.584292028099298, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9eb44ba658f639bdbaf1826fa289b0eb2817b44d395237da065f5be90c480044", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1057 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a4e401a3a2e19b15a8d6600e", "attempt_id": "abb785bc653a", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:02.912395Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 15}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 659, "message_tokens": 570, "message_utf8_bytes": 1631, "cache_tensor_bytes": null, "serialized_payload_bytes": 1631, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12830.007417011075, "ttft_ms": 13.909582979977131, "decode_ms": 136.0027079936117, "receiver_prefill_ms": 75.20962494891137}, "total_wall_ms": 13056.573792011477, "ttft_ms": 13.909582979977131, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,926,224 CAD", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3ed2d5b7c9724067efc8c50c7e6e06d122e8f30ce4a7f22dfc861b7b3481da52", "output_hash": "469758eb51aa9aa28367572d59bfb330d2224ef4b69a21eca47c0980dacbcc3b"} | ||||
| 1058 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b4d8e56ded3852ed6272072a", "attempt_id": "ea9f13f52b30", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:03.157396Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 15}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 661, "message_tokens": 570, "message_utf8_bytes": 1631, "cache_tensor_bytes": null, "serialized_payload_bytes": 1631, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12830.007417011075, "ttft_ms": 13.384709018282592, "decode_ms": 147.6515829563141, "receiver_prefill_ms": 75.23533294443041}, "total_wall_ms": 13067.65662599355, "ttft_ms": 13.384709018282592, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-64S-4555", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3ed2d5b7c9724067efc8c50c7e6e06d122e8f30ce4a7f22dfc861b7b3481da52", "output_hash": "f6f8ca3da45dc6c01a3dede99eab98f0f3fd2d2c5e105791d9c68c607877ed22"} | ||||
| 1059 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "7feb10fe60a8068ef943ed44", "attempt_id": "f7f1cb0b7e7d", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:03.413974Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 15}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 667, "message_tokens": 570, "message_utf8_bytes": 1631, "cache_tensor_bytes": null, "serialized_payload_bytes": 1631, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12830.007417011075, "ttft_ms": 13.376667047850788, "decode_ms": 107.30066697578877, "receiver_prefill_ms": 75.11304109357297}, "total_wall_ms": 13027.133292052895, "ttft_ms": 13.376667047850788, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9119.650", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3ed2d5b7c9724067efc8c50c7e6e06d122e8f30ce4a7f22dfc861b7b3481da52", "output_hash": "a758b714660e7268fc27a5814beb28446c47a2ebb89e12e43c736cd5276a4e45"} | ||||
| 1060 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a5d831169b3d00fb5af20e7c", "attempt_id": "2ded618c2416", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:03.629071Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 15}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 662, "message_tokens": 570, "message_utf8_bytes": 1631, "cache_tensor_bytes": null, "serialized_payload_bytes": 1631, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12830.007417011075, "ttft_ms": 13.329041074030101, "decode_ms": 13.33454204723239, "receiver_prefill_ms": 74.92666598409414}, "total_wall_ms": 12932.93000094127, "ttft_ms": 13.329041074030101, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3ed2d5b7c9724067efc8c50c7e6e06d122e8f30ce4a7f22dfc861b7b3481da52", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1061 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9644cfcf7a4887192c0cfe01", "attempt_id": "dc6939d16f51", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:03.748879Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 15}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 670, "message_tokens": 570, "message_utf8_bytes": 1631, "cache_tensor_bytes": null, "serialized_payload_bytes": 1631, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12830.007417011075, "ttft_ms": 13.60695797484368, "decode_ms": 53.31479199230671, "receiver_prefill_ms": 75.0788749428466}, "total_wall_ms": 12973.385166958906, "ttft_ms": 13.60695797484368, "input_usage": {}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Melruk-3", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3ed2d5b7c9724067efc8c50c7e6e06d122e8f30ce4a7f22dfc861b7b3481da52", "output_hash": "29e02c51d1e6eeabd8d3fcec3b482c44c02ebc350a5d4b73304fcba97294db93"} | ||||
| 1062 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "51a4948ae15fc72148de8458", "attempt_id": "e628d1ff5323", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:03.909216Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 15}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 664, "message_tokens": 570, "message_utf8_bytes": 1631, "cache_tensor_bytes": null, "serialized_payload_bytes": 1631, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12830.007417011075, "ttft_ms": 13.44929204788059, "decode_ms": 93.3201250154525, "receiver_prefill_ms": 74.76579106878489}, "total_wall_ms": 13012.867292040028, "ttft_ms": 13.44929204788059, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5926224", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3ed2d5b7c9724067efc8c50c7e6e06d122e8f30ce4a7f22dfc861b7b3481da52", "output_hash": "7c1113578ca4e75c3dd3a916eae945b8147de18f2e9b429a97f3e3481fa7d2fc"} | ||||
| 1063 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "7b5393a901d5c11b10da5201", "attempt_id": "e365416a9c60", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:04.109336Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 15}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 665, "message_tokens": 570, "message_utf8_bytes": 1631, "cache_tensor_bytes": null, "serialized_payload_bytes": 1631, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12830.007417011075, "ttft_ms": 13.426417019218206, "decode_ms": 13.1738749332726, "receiver_prefill_ms": 74.56199999433011}, "total_wall_ms": 12932.435624999925, "ttft_ms": 13.426417019218206, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3ed2d5b7c9724067efc8c50c7e6e06d122e8f30ce4a7f22dfc861b7b3481da52", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1064 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9049976a51c8218dab3c5a98", "attempt_id": "e38bdfa7c949", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:04.229236Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 15}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 666, "message_tokens": 570, "message_utf8_bytes": 1631, "cache_tensor_bytes": null, "serialized_payload_bytes": 1631, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12830.007417011075, "ttft_ms": 13.150707934983075, "decode_ms": 13.477290980517864, "receiver_prefill_ms": 74.24574997276068}, "total_wall_ms": 12932.265999959782, "ttft_ms": 13.150707934983075, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3ed2d5b7c9724067efc8c50c7e6e06d122e8f30ce4a7f22dfc861b7b3481da52", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1065 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "bbf707c30968d770eef51d16", "attempt_id": "51061678de67", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:17.152260Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 714, "message_tokens": 626, "message_utf8_bytes": 1629, "cache_tensor_bytes": null, "serialized_payload_bytes": 1629, "side_information_bytes": 0, "fetched_bytes": 926, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12803.8252920378, "ttft_ms": 13.277083984576166, "decode_ms": 93.5497919563204, "receiver_prefill_ms": 78.69395799934864}, "total_wall_ms": 12991.238376125693, "ttft_ms": 13.277083984576166, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8544550", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "784f9df6e6021c164bc4f5667279585d1722c0ab1ac935b2028a0cd6485dd48a", "output_hash": "7ea69da7ca13297bce5fac6a79b7f74d78548d728dc85a91c943d1c2c8172768"} | ||||
| 1066 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "363c4e7ca56070ddc327624f", "attempt_id": "a53a3a39a72a", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:17.362412Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 716, "message_tokens": 626, "message_utf8_bytes": 1629, "cache_tensor_bytes": null, "serialized_payload_bytes": 1629, "side_information_bytes": 0, "fetched_bytes": 926, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12803.8252920378, "ttft_ms": 13.364790938794613, "decode_ms": 13.386250007897615, "receiver_prefill_ms": 77.86524994298816}, "total_wall_ms": 12909.889208967797, "ttft_ms": 13.364790938794613, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "784f9df6e6021c164bc4f5667279585d1722c0ab1ac935b2028a0cd6485dd48a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1067 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "133b20460c7b16b478d5611b", "attempt_id": "af231495fbbb", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:17.485275Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 687, "message_tokens": 591, "message_utf8_bytes": 1619, "cache_tensor_bytes": null, "serialized_payload_bytes": 1619, "side_information_bytes": 0, "fetched_bytes": 920, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12803.8252920378, "ttft_ms": 13.611791073344648, "decode_ms": 92.91875001508743, "receiver_prefill_ms": 76.76341698970646}, "total_wall_ms": 12988.52620809339, "ttft_ms": 13.611791073344648, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8995865", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "16bef4f5181f17888ee076c3812965f375bb03049319c8e2b4e112e86524ff97", "output_hash": "bce25ee55f2656e972d49f9c0a22f2219979f1bd4e5965f2424a502257eef0a9"} | ||||
| 1068 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "51dcb2487ea2265bf6871b6a", "attempt_id": "8082169b51ce", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:17.687105Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 717, "message_tokens": 626, "message_utf8_bytes": 1629, "cache_tensor_bytes": null, "serialized_payload_bytes": 1629, "side_information_bytes": 0, "fetched_bytes": 926, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12803.8252920378, "ttft_ms": 13.30454193521291, "decode_ms": 93.2469159597531, "receiver_prefill_ms": 77.68229197245091}, "total_wall_ms": 12989.51745906379, "ttft_ms": 13.30454193521291, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9781740", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c1e6f711d2e4793023f695e01e3d4e6522e46db8793e480a347dc408c6191258", "output_hash": "8b57ccd1ed84757887221612d34399545b6be9ebd8480805f7c2b5ffaa4dea1c"} | ||||
| 1069 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "cd8be5aa65eca31717f4f69b", "attempt_id": "99554637cfac", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:17.890085Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 725, "message_tokens": 626, "message_utf8_bytes": 1629, "cache_tensor_bytes": null, "serialized_payload_bytes": 1629, "side_information_bytes": 0, "fetched_bytes": 926, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12803.8252920378, "ttft_ms": 13.529415940865874, "decode_ms": 66.58237497322261, "receiver_prefill_ms": 78.45983398146927}, "total_wall_ms": 12963.804542087018, "ttft_ms": 13.529415940865874, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ixbanruk-3", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "784f9df6e6021c164bc4f5667279585d1722c0ab1ac935b2028a0cd6485dd48a", "output_hash": "1cc74509d5485de66115e1f6b591a4a84f89826fbba3b26cfbf7cfcfdc216bf5"} | ||||
| 1070 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "bd86d6e72f8f782566602058", "attempt_id": "3bcc6ab9d77b", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:18.067430Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 719, "message_tokens": 626, "message_utf8_bytes": 1629, "cache_tensor_bytes": null, "serialized_payload_bytes": 1629, "side_information_bytes": 0, "fetched_bytes": 926, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12803.8252920378, "ttft_ms": 13.115542009472847, "decode_ms": 132.8475830378011, "receiver_prefill_ms": 78.30358401406556}, "total_wall_ms": 13029.5239581028, "ttft_ms": 13.115542009472847, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "32,261,765", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "784f9df6e6021c164bc4f5667279585d1722c0ab1ac935b2028a0cd6485dd48a", "output_hash": "970de185b6e73d597ba9e045394d564cfc69d8e36403c3ab2c02ee74da377ad9"} | ||||
| 1071 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e85d9f6f6fd17020f4b24f31", "attempt_id": "7619d48e2587", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:18.310056Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 720, "message_tokens": 626, "message_utf8_bytes": 1629, "cache_tensor_bytes": null, "serialized_payload_bytes": 1629, "side_information_bytes": 0, "fetched_bytes": 926, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12803.8252920378, "ttft_ms": 13.520332984626293, "decode_ms": 13.20024998858571, "receiver_prefill_ms": 77.8793750796467}, "total_wall_ms": 12909.82833399903, "ttft_ms": 13.520332984626293, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "784f9df6e6021c164bc4f5667279585d1722c0ab1ac935b2028a0cd6485dd48a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1072 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0799fbeff837fb36192118fa", "attempt_id": "c69dc620449e", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:18.433263Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 721, "message_tokens": 626, "message_utf8_bytes": 1629, "cache_tensor_bytes": null, "serialized_payload_bytes": 1629, "side_information_bytes": 0, "fetched_bytes": 926, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12803.8252920378, "ttft_ms": 13.208749936893582, "decode_ms": 13.199875014834106, "receiver_prefill_ms": 78.20004201494157}, "total_wall_ms": 12909.903916995972, "ttft_ms": 13.208749936893582, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "784f9df6e6021c164bc4f5667279585d1722c0ab1ac935b2028a0cd6485dd48a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1073 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b8e915a084ce517a4039bf43", "attempt_id": "e457b533a060", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:19.291547Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 227856384}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 42, "message_tokens": null, "message_utf8_bytes": 30052, "cache_tensor_bytes": 227856384, "serialized_payload_bytes": 227856384, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 735.037749982439, "ttft_ms": 53.70887496974319, "decode_ms": 106.23174998909235, "receiver_prefill_ms": 0.0}, "total_wall_ms": 904.3665840290487, "ttft_ms": 53.70887496974319, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8544550", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "7ea69da7ca13297bce5fac6a79b7f74d78548d728dc85a91c943d1c2c8172768"} | ||||
| 1074 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c22b5eff84682d6098bf0f13", "attempt_id": "9b7cd5663932", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:19.478226Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 227856384}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 30052, "cache_tensor_bytes": 227856384, "serialized_payload_bytes": 227856384, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 735.037749982439, "ttft_ms": 48.04024996701628, "decode_ms": 165.4460000572726, "receiver_prefill_ms": 0.0}, "total_wall_ms": 955.4720829473808, "ttft_ms": 48.04024996701628, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-67G-1446", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "17765d5cd1a65fba6a352dc360b5880164ca5fbfb993c9932800bca1d99b7480"} | ||||
| 1075 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "bb7df9f6acbdba0bf171a05d", "attempt_id": "3aeea65721e9", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:19.715831Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 227856384}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 50, "message_tokens": null, "message_utf8_bytes": 30052, "cache_tensor_bytes": 227856384, "serialized_payload_bytes": 227856384, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 735.037749982439, "ttft_ms": 48.31158299930394, "decode_ms": 104.78958394378424, "receiver_prefill_ms": 0.0}, "total_wall_ms": 895.5197499599308, "ttft_ms": 48.31158299930394, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8995865", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "bce25ee55f2656e972d49f9c0a22f2219979f1bd4e5965f2424a502257eef0a9"} | ||||
| 1076 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "45acd3251e8c45aca30693ff", "attempt_id": "95e754255487", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:19.893885Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 227856384}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 45, "message_tokens": null, "message_utf8_bytes": 30052, "cache_tensor_bytes": 227856384, "serialized_payload_bytes": 227856384, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 735.037749982439, "ttft_ms": 47.06091689877212, "decode_ms": 105.19037500489503, "receiver_prefill_ms": 0.0}, "total_wall_ms": 894.6441250154749, "ttft_ms": 47.06091689877212, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7730705", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "6c885473fb45b44c6a425cd3cd307b4771e35351a0e2c17186a92d2de9c1fd42"} | ||||
| 1077 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b0a7854308b71e8b7cde5901", "attempt_id": "be4d11672b5c", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:20.070662Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 227856384}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 53, "message_tokens": null, "message_utf8_bytes": 30052, "cache_tensor_bytes": 227856384, "serialized_payload_bytes": 227856384, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 735.037749982439, "ttft_ms": 48.55720803607255, "decode_ms": 74.8714170185849, "receiver_prefill_ms": 0.0}, "total_wall_ms": 865.6046659452841, "ttft_ms": 48.55720803607255, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ixbanruk-3", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "1cc74509d5485de66115e1f6b591a4a84f89826fbba3b26cfbf7cfcfdc216bf5"} | ||||
| 1078 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6ee3ce4cf1af3be44d3abfba", "attempt_id": "d772efc29f40", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:20.218488Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 227856384}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30052, "cache_tensor_bytes": 227856384, "serialized_payload_bytes": 227856384, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 735.037749982439, "ttft_ms": 45.48958293162286, "decode_ms": 149.7669160598889, "receiver_prefill_ms": 0.0}, "total_wall_ms": 937.8280839882791, "ttft_ms": 45.48958293162286, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20,647,154", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "0707b34b969871d1901b99df68dc3821da0c02077f67e1c7c6030289924e4363"} | ||||
| 1079 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3a2b4093ffd01cd7a8aefb70", "attempt_id": "0b219002f0a1", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:20.438636Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 227856384}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 48, "message_tokens": null, "message_utf8_bytes": 30052, "cache_tensor_bytes": 227856384, "serialized_payload_bytes": 227856384, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 735.037749982439, "ttft_ms": 47.02149995137006, "decode_ms": 15.020041028037667, "receiver_prefill_ms": 0.0}, "total_wall_ms": 804.4304579962045, "ttft_ms": 47.02149995137006, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1080 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "cc037e488023ec57146d1d5b", "attempt_id": "fa41d77846d7", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:20.524876Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 227856384}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 30052, "cache_tensor_bytes": 227856384, "serialized_payload_bytes": 227856384, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 735.037749982439, "ttft_ms": 46.92787502426654, "decode_ms": 14.99320799484849, "receiver_prefill_ms": 0.0}, "total_wall_ms": 803.4068749984726, "ttft_ms": 46.92787502426654, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1081 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b4e6b69aaeb12a203f9ccf72", "attempt_id": "bf97bc85cceb", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:20.610292Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6301, "message_tokens": 6217, "message_utf8_bytes": 30582, "cache_tensor_bytes": null, "serialized_payload_bytes": 30582, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.036457902751863, "ttft_ms": 13.901624944992363, "decode_ms": 123.75337490811944, "receiver_prefill_ms": 747.6423329208046}, "total_wall_ms": 895.0238329125568, "ttft_ms": 13.901624944992363, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,544,550", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b702fdc180b60aa41840fd0f3fd93ce8396baf534a968c6d07646f9bb039f461", "output_hash": "275c8abab9d6375639c672e5391f7a9637810a7c2d3985510d6d956c3cb3a509"} | ||||
| 1082 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "32e300742405ffc74d91f530", "attempt_id": "4445e6788cc1", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:21.521561Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6303, "message_tokens": 6217, "message_utf8_bytes": 30582, "cache_tensor_bytes": null, "serialized_payload_bytes": 30582, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.036457902751863, "ttft_ms": 14.233874971978366, "decode_ms": 152.04033302143216, "receiver_prefill_ms": 759.1276670573279}, "total_wall_ms": 935.2202918380499, "ttft_ms": 14.233874971978366, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-64S-4555", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b702fdc180b60aa41840fd0f3fd93ce8396baf534a968c6d07646f9bb039f461", "output_hash": "f6f8ca3da45dc6c01a3dede99eab98f0f3fd2d2c5e105791d9c68c607877ed22"} | ||||
| 1083 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0d22bcac3fa5cfffa1416d8c", "attempt_id": "7e97a71fc331", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:22.473928Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6309, "message_tokens": 6217, "message_utf8_bytes": 30582, "cache_tensor_bytes": null, "serialized_payload_bytes": 30582, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.036457902751863, "ttft_ms": 14.046124997548759, "decode_ms": 96.16337495390326, "receiver_prefill_ms": 772.1485830843449}, "total_wall_ms": 892.1603738563135, "ttft_ms": 14.046124997548759, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8859765", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b702fdc180b60aa41840fd0f3fd93ce8396baf534a968c6d07646f9bb039f461", "output_hash": "8d800485162553e438ca8ddff7de5613a4800ab0aeecee4f411e1cec8e2008bd"} | ||||
| 1084 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2bf9f81d93cdf14b82a6c605", "attempt_id": "7205e95d8523", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:23.383933Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6304, "message_tokens": 6217, "message_utf8_bytes": 30582, "cache_tensor_bytes": null, "serialized_payload_bytes": 30582, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.036457902751863, "ttft_ms": 13.921791920438409, "decode_ms": 96.95462498348206, "receiver_prefill_ms": 804.5001659775153}, "total_wall_ms": 925.121916923672, "ttft_ms": 13.921791920438409, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7730705", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b702fdc180b60aa41840fd0f3fd93ce8396baf534a968c6d07646f9bb039f461", "output_hash": "6c885473fb45b44c6a425cd3cd307b4771e35351a0e2c17186a92d2de9c1fd42"} | ||||
| 1085 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "79489f79ccda836ce28ef36a", "attempt_id": "8b123f9214d4", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:24.326095Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6312, "message_tokens": 6217, "message_utf8_bytes": 30582, "cache_tensor_bytes": null, "serialized_payload_bytes": 30582, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.036457902751863, "ttft_ms": 14.041124959476292, "decode_ms": 69.7017089696601, "receiver_prefill_ms": 786.4734580507502}, "total_wall_ms": 879.8140408471227, "ttft_ms": 14.041124959476292, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ixbanruk-3", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b702fdc180b60aa41840fd0f3fd93ce8396baf534a968c6d07646f9bb039f461", "output_hash": "1cc74509d5485de66115e1f6b591a4a84f89826fbba3b26cfbf7cfcfdc216bf5"} | ||||
| 1086 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "026d4d11a732cc9d22f07d10", "attempt_id": "4de259a65ae8", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:25.222704Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6306, "message_tokens": 6217, "message_utf8_bytes": 30582, "cache_tensor_bytes": null, "serialized_payload_bytes": 30582, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.036457902751863, "ttft_ms": 14.483500039204955, "decode_ms": 112.81841702293605, "receiver_prefill_ms": 802.0694579463452}, "total_wall_ms": 940.1143328286707, "ttft_ms": 14.483500039204955, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21744419", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b702fdc180b60aa41840fd0f3fd93ce8396baf534a968c6d07646f9bb039f461", "output_hash": "12e9cb5b890550a52cda5bdc057fe69b1b0e684eaf06b09da11cc7e313cdf7a7"} | ||||
| 1087 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "47ce83c427394e8de0bc8f3b", "attempt_id": "4a5d8a425653", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:26.179952Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6307, "message_tokens": 6217, "message_utf8_bytes": 30582, "cache_tensor_bytes": null, "serialized_payload_bytes": 30582, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.036457902751863, "ttft_ms": 14.126459020189941, "decode_ms": 13.839541003108025, "receiver_prefill_ms": 798.2102080713958}, "total_wall_ms": 835.9402908245102, "ttft_ms": 14.126459020189941, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b702fdc180b60aa41840fd0f3fd93ce8396baf534a968c6d07646f9bb039f461", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1088 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "81983e8d224228574fd61803", "attempt_id": "b39662985675", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:27.033836Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 6308, "message_tokens": 6217, "message_utf8_bytes": 30582, "cache_tensor_bytes": null, "serialized_payload_bytes": 30582, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.036457902751863, "ttft_ms": 14.28387500345707, "decode_ms": 13.76383297611028, "receiver_prefill_ms": 814.1360419103876}, "total_wall_ms": 852.1435419097543, "ttft_ms": 14.28387500345707, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b702fdc180b60aa41840fd0f3fd93ce8396baf534a968c6d07646f9bb039f461", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1089 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9334118a4bd5adeed6b56945", "attempt_id": "c179718cf38e", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:51.283032Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1677}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1786, "message_tokens": 1701, "message_utf8_bytes": 6315, "cache_tensor_bytes": null, "serialized_payload_bytes": 6315, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23379.230667022057, "ttft_ms": 13.489042059518397, "decode_ms": 123.15150001086295, "receiver_prefill_ms": 186.11733301077038}, "total_wall_ms": 23707.162084057927, "ttft_ms": 13.489042059518397, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,730,705", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "bf1dfd9b854995ec8ba51cff051d35793afdffacd18b48cff91f7b39fb8a9ccd", "output_hash": "2e0f40d8945ba6021c3c207215c3d834da5944796960b093ea104a759c7b3bd0"} | ||||
| 1090 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e1137d27137888bd90a0c855", "attempt_id": "7eaad7334598", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:51.628576Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1677}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1788, "message_tokens": 1701, "message_utf8_bytes": 6315, "cache_tensor_bytes": null, "serialized_payload_bytes": 6315, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23379.230667022057, "ttft_ms": 13.404750032350421, "decode_ms": 148.78950000274926, "receiver_prefill_ms": 185.85150002036244}, "total_wall_ms": 23730.235458002426, "ttft_ms": 13.404750032350421, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-64S-4555", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "bf1dfd9b854995ec8ba51cff051d35793afdffacd18b48cff91f7b39fb8a9ccd", "output_hash": "f6f8ca3da45dc6c01a3dede99eab98f0f3fd2d2c5e105791d9c68c607877ed22"} | ||||
| 1091 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "cd3642d65df0fc015bb9f03c", "attempt_id": "62dbc11e03d4", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:51.996997Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1677}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1794, "message_tokens": 1701, "message_utf8_bytes": 6315, "cache_tensor_bytes": null, "serialized_payload_bytes": 6315, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23379.230667022057, "ttft_ms": 14.217249932698905, "decode_ms": 94.61891697719693, "receiver_prefill_ms": 193.10587493237108}, "total_wall_ms": 23684.089625021443, "ttft_ms": 14.217249932698905, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8859765", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "bf1dfd9b854995ec8ba51cff051d35793afdffacd18b48cff91f7b39fb8a9ccd", "output_hash": "8d800485162553e438ca8ddff7de5613a4800ab0aeecee4f411e1cec8e2008bd"} | ||||
| 1092 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "eb1602b81815b8e725c12cca", "attempt_id": "b8d91cb856c7", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:52.319585Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1677}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1789, "message_tokens": 1701, "message_utf8_bytes": 6315, "cache_tensor_bytes": null, "serialized_payload_bytes": 6315, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23379.230667022057, "ttft_ms": 13.726374949328601, "decode_ms": 122.53766704816371, "receiver_prefill_ms": 185.95604202710092}, "total_wall_ms": 23704.3878340628, "ttft_ms": 13.726374949328601, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,730,705", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "bf1dfd9b854995ec8ba51cff051d35793afdffacd18b48cff91f7b39fb8a9ccd", "output_hash": "2e0f40d8945ba6021c3c207215c3d834da5944796960b093ea104a759c7b3bd0"} | ||||
| 1093 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "51a9288e9694dc4897374c73", "attempt_id": "6401d41399ce", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:52.663643Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1677}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1797, "message_tokens": 1701, "message_utf8_bytes": 6315, "cache_tensor_bytes": null, "serialized_payload_bytes": 6315, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23379.230667022057, "ttft_ms": 13.569333008490503, "decode_ms": 54.109707940369844, "receiver_prefill_ms": 193.085000035353}, "total_wall_ms": 23642.942083999515, "ttft_ms": 13.569333008490503, "input_usage": {}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Melruk-3", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "bf1dfd9b854995ec8ba51cff051d35793afdffacd18b48cff91f7b39fb8a9ccd", "output_hash": "29e02c51d1e6eeabd8d3fcec3b482c44c02ebc350a5d4b73304fcba97294db93"} | ||||
| 1094 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1c57b1ab04800f5fe2a94e02", "attempt_id": "daed4660ed00", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:52.944602Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1677}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1791, "message_tokens": 1701, "message_utf8_bytes": 6315, "cache_tensor_bytes": null, "serialized_payload_bytes": 6315, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23379.230667022057, "ttft_ms": 13.64741602446884, "decode_ms": 109.05704193282872, "receiver_prefill_ms": 187.1469171019271}, "total_wall_ms": 23691.961333039217, "ttft_ms": 13.64741602446884, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20481494", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "bf1dfd9b854995ec8ba51cff051d35793afdffacd18b48cff91f7b39fb8a9ccd", "output_hash": "9d5abea7e2661ec79dfef72bd0d183cd72ed188689c10073a76f648abf169abf"} | ||||
| 1095 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0363a8b8d4ddca2e4968857a", "attempt_id": "8f5854c7cdb9", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:53.274456Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1677}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1792, "message_tokens": 1701, "message_utf8_bytes": 6315, "cache_tensor_bytes": null, "serialized_payload_bytes": 6315, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23379.230667022057, "ttft_ms": 13.58570798765868, "decode_ms": 14.308791956864297, "receiver_prefill_ms": 193.83641704916954}, "total_wall_ms": 23603.843625984155, "ttft_ms": 13.58570798765868, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "bf1dfd9b854995ec8ba51cff051d35793afdffacd18b48cff91f7b39fb8a9ccd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1096 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8a2a1506d4709737926792db", "attempt_id": "c53da7cbad67", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:24:53.516392Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1677}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1793, "message_tokens": 1701, "message_utf8_bytes": 6315, "cache_tensor_bytes": null, "serialized_payload_bytes": 6315, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23379.230667022057, "ttft_ms": 14.23129194881767, "decode_ms": 13.558416976593435, "receiver_prefill_ms": 200.81454096361995}, "total_wall_ms": 23610.73416704312, "ttft_ms": 14.23129194881767, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "bf1dfd9b854995ec8ba51cff051d35793afdffacd18b48cff91f7b39fb8a9ccd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1097 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5b24ac2557ff43303f5cf646", "attempt_id": "85800351fc9d", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:20.285534Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1202, "message_tokens": 1113, "message_utf8_bytes": 2987, "cache_tensor_bytes": null, "serialized_payload_bytes": 2987, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26520.410542027093, "ttft_ms": 13.765583047643304, "decode_ms": 121.388208004646, "receiver_prefill_ms": 152.4447079282254}, "total_wall_ms": 26810.068625956774, "ttft_ms": 13.765583047643304, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,511,935", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "747cbfa9e09159527e79b5030dde7e23b2781f07b3aedfb601ba0642942f12fb", "output_hash": "3a6662e1122f9912388636d0e6506f4bda89215a4961a1ea0574efb588a05047"} | ||||
| 1098 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "70d44ba4b873b6b1f9577ae0", "attempt_id": "3f38eb3cd5db", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:20.595313Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1204, "message_tokens": 1113, "message_utf8_bytes": 2987, "cache_tensor_bytes": null, "serialized_payload_bytes": 2987, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26520.410542027093, "ttft_ms": 13.834709068760276, "decode_ms": 147.40666595753282, "receiver_prefill_ms": 792.1068749856204}, "total_wall_ms": 27475.66970891785, "ttft_ms": 13.834709068760276, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-64S-4555", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "747cbfa9e09159527e79b5030dde7e23b2781f07b3aedfb601ba0642942f12fb", "output_hash": "f6f8ca3da45dc6c01a3dede99eab98f0f3fd2d2c5e105791d9c68c607877ed22"} | ||||
| 1099 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f869b2271be8ef84c61f6afb", "attempt_id": "44a4ce0fb169", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:21.568776Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1210, "message_tokens": 1113, "message_utf8_bytes": 2987, "cache_tensor_bytes": null, "serialized_payload_bytes": 2987, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26520.410542027093, "ttft_ms": 14.015499968081713, "decode_ms": 97.33570797834545, "receiver_prefill_ms": 1040.7460830174387}, "total_wall_ms": 27674.47704204824, "ttft_ms": 14.015499968081713, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8859765", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "747cbfa9e09159527e79b5030dde7e23b2781f07b3aedfb601ba0642942f12fb", "output_hash": "8d800485162553e438ca8ddff7de5613a4800ab0aeecee4f411e1cec8e2008bd"} | ||||
| 1100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f12ad7bd2689dcac693aafc3", "attempt_id": "6b53c2a77c8b", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:22.740383Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1205, "message_tokens": 1113, "message_utf8_bytes": 2987, "cache_tensor_bytes": null, "serialized_payload_bytes": 2987, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26520.410542027093, "ttft_ms": 13.66258307825774, "decode_ms": 94.25008308608085, "receiver_prefill_ms": 127.36725003924221}, "total_wall_ms": 26757.666500052437, "ttft_ms": 13.66258307825774, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4135500", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "747cbfa9e09159527e79b5030dde7e23b2781f07b3aedfb601ba0642942f12fb", "output_hash": "6b5630c7cd8c2ad9a5337e78631ba45cc68e9c5436ea5150720f9dd9bfb6efeb"} | ||||
| 1101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5740235f81a241df9985bd33", "attempt_id": "c8dd03611066", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:23.001509Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1213, "message_tokens": 1113, "message_utf8_bytes": 2987, "cache_tensor_bytes": null, "serialized_payload_bytes": 2987, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26520.410542027093, "ttft_ms": 13.417250011116266, "decode_ms": 93.88745902106166, "receiver_prefill_ms": 126.45504192914814}, "total_wall_ms": 26756.021333043464, "ttft_ms": 13.417250011116266, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Project Ixbanruk-3", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "747cbfa9e09159527e79b5030dde7e23b2781f07b3aedfb601ba0642942f12fb", "output_hash": "4a52ee5b39aab55ee71eb97b7711e35dfa06dc12696c2a891362eb74c0d5207e"} | ||||
| 1102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e4ab930c5788a997d0639ef4", "attempt_id": "f309d22631ab", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:23.254777Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1207, "message_tokens": 1113, "message_utf8_bytes": 2987, "cache_tensor_bytes": null, "serialized_payload_bytes": 2987, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26520.410542027093, "ttft_ms": 13.695707893930376, "decode_ms": 110.66654196474701, "receiver_prefill_ms": 142.8877910366282}, "total_wall_ms": 26789.54279201571, "ttft_ms": 13.695707893930376, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12241.22", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "747cbfa9e09159527e79b5030dde7e23b2781f07b3aedfb601ba0642942f12fb", "output_hash": "006931ee535eb411cabd77f6d126839bfffa0d95467d27b4136651e9c49e8dcc"} | ||||
| 1103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9f30d57aea26246b9b8d4454", "attempt_id": "7a67133f5397", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:23.541982Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1208, "message_tokens": 1113, "message_utf8_bytes": 2987, "cache_tensor_bytes": null, "serialized_payload_bytes": 2987, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26520.410542027093, "ttft_ms": 13.846542104147375, "decode_ms": 13.605790911242366, "receiver_prefill_ms": 127.07837508060038}, "total_wall_ms": 26676.88600101974, "ttft_ms": 13.846542104147375, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "747cbfa9e09159527e79b5030dde7e23b2781f07b3aedfb601ba0642942f12fb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f63898df23131daf9a0dbd96", "attempt_id": "7458378380c4", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:23.716424Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 1209, "message_tokens": 1113, "message_utf8_bytes": 2987, "cache_tensor_bytes": null, "serialized_payload_bytes": 2987, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26520.410542027093, "ttft_ms": 13.833209057338536, "decode_ms": 13.417958049103618, "receiver_prefill_ms": 126.33054098114371}, "total_wall_ms": 26675.948542077094, "ttft_ms": 13.833209057338536, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "747cbfa9e09159527e79b5030dde7e23b2781f07b3aedfb601ba0642942f12fb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "767d99c0e9e8622968d908f3", "attempt_id": "7bf1b9244d0f", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:50.778134Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 2523, "message_tokens": 2435, "message_utf8_bytes": 6413, "cache_tensor_bytes": null, "serialized_payload_bytes": 6413, "side_information_bytes": 0, "fetched_bytes": 3402, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26888.076208066195, "ttft_ms": 13.58887495007366, "decode_ms": 95.46912496443838, "receiver_prefill_ms": 339.3963749986142}, "total_wall_ms": 27339.99450004194, "ttft_ms": 13.58887495007366, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8544550", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "d6ed45c4e8799ecab484b9b3255a5cf11e403a36f30281ae82d0f26a5ecdd4da", "output_hash": "7ea69da7ca13297bce5fac6a79b7f74d78548d728dc85a91c943d1c2c8172768"} | ||||
| 1106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9c98bd0c116b48a5a9541a83", "attempt_id": "9cd1ff56b78a", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:51.251407Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 2431, "message_tokens": 2341, "message_utf8_bytes": 6262, "cache_tensor_bytes": null, "serialized_payload_bytes": 6262, "side_information_bytes": 0, "fetched_bytes": 3224, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26888.076208066195, "ttft_ms": 15.687250066548586, "decode_ms": 156.32220800034702, "receiver_prefill_ms": 268.3007079176605}, "total_wall_ms": 27332.409708062187, "ttft_ms": 15.687250066548586, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-64S-4555", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e3bf0ebd4720fa89725d12f075c2b7f52b7418060d7e130ffc3b3047a0791da9", "output_hash": "f6f8ca3da45dc6c01a3dede99eab98f0f3fd2d2c5e105791d9c68c607877ed22"} | ||||
| 1107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c0c592c6f077d16e659ce8c1", "attempt_id": "fc03a360ff99", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:51.713231Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 2544, "message_tokens": 2448, "message_utf8_bytes": 6438, "cache_tensor_bytes": null, "serialized_payload_bytes": 6438, "side_information_bytes": 0, "fetched_bytes": 3435, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26888.076208066195, "ttft_ms": 13.5238750372082, "decode_ms": 94.09354208037257, "receiver_prefill_ms": 272.66583300661296}, "total_wall_ms": 27271.796248969622, "ttft_ms": 13.5238750372082, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8859765", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "53730a438dd04b0dc24e95e40d099eafee059df7c6f19edf2d66bf557a1b2723", "output_hash": "8d800485162553e438ca8ddff7de5613a4800ab0aeecee4f411e1cec8e2008bd"} | ||||
| 1108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1f87818bc9dd8fd7fa24041a", "attempt_id": "79b58e363455", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:52.114870Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 2554, "message_tokens": 2463, "message_utf8_bytes": 6432, "cache_tensor_bytes": null, "serialized_payload_bytes": 6432, "side_information_bytes": 0, "fetched_bytes": 3400, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26888.076208066195, "ttft_ms": 14.196708099916577, "decode_ms": 101.0192499961704, "receiver_prefill_ms": 321.00641692522913}, "total_wall_ms": 27328.256541048177, "ttft_ms": 14.196708099916577, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7730705", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "d51aa1fe2a5742939ae0666dfcc473ea400df4de38851092ca6477ec3d971a92", "output_hash": "6c885473fb45b44c6a425cd3cd307b4771e35351a0e2c17186a92d2de9c1fd42"} | ||||
| 1109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "439606f95d6f10c3fe77d29a", "attempt_id": "1e4975bdbfd0", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:52.572439Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 2479, "message_tokens": 2380, "message_utf8_bytes": 6356, "cache_tensor_bytes": null, "serialized_payload_bytes": 6356, "side_information_bytes": 0, "fetched_bytes": 3341, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26888.076208066195, "ttft_ms": 13.779791072010994, "decode_ms": 68.90887499321252, "receiver_prefill_ms": 285.1857499917969}, "total_wall_ms": 27259.479833068326, "ttft_ms": 13.779791072010994, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ixbanruk-3", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e2b137540b050874bf12be3f3a3691cdf223954f88be95b33f91fd94248fbb91", "output_hash": "1cc74509d5485de66115e1f6b591a4a84f89826fbba3b26cfbf7cfcfdc216bf5"} | ||||
| 1110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e70d3bf95c32d9fae3f208b0", "attempt_id": "e275a476af6e", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:52.962136Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 2553, "message_tokens": 2460, "message_utf8_bytes": 6458, "cache_tensor_bytes": null, "serialized_payload_bytes": 6458, "side_information_bytes": 0, "fetched_bytes": 3442, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26888.076208066195, "ttft_ms": 13.95712501835078, "decode_ms": 109.83708407729864, "receiver_prefill_ms": 297.77166701387614}, "total_wall_ms": 27313.128958106972, "ttft_ms": 13.95712501835078, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "19481404", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "739e83c574a741472bef8ca979562304ce4f38b503e223dee734c42177f34e0f", "output_hash": "7d6899209731cb544f6e2e5dd7090eaaa4d0b08762381b8d095485e142441fae"} | ||||
| 1111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d36e50416d8323854385a52e", "attempt_id": "ff2eceb6a5f3", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:53.404417Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 2471, "message_tokens": 2377, "message_utf8_bytes": 6380, "cache_tensor_bytes": null, "serialized_payload_bytes": 6380, "side_information_bytes": 0, "fetched_bytes": 3333, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26888.076208066195, "ttft_ms": 13.673666981048882, "decode_ms": 13.49762489553541, "receiver_prefill_ms": 296.0884579224512}, "total_wall_ms": 27214.598666061647, "ttft_ms": 13.673666981048882, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "027c7a7b1e75fdca60c0c6fd7d00862d125cd0c46e0abceeb5dd683016e3b1f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4498549f33396572986e9ff0", "attempt_id": "712d479eb390", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:53.748389Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 2530, "message_tokens": 2435, "message_utf8_bytes": 6413, "cache_tensor_bytes": null, "serialized_payload_bytes": 6413, "side_information_bytes": 0, "fetched_bytes": 3402, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26888.076208066195, "ttft_ms": 13.92537506762892, "decode_ms": 13.51895893458277, "receiver_prefill_ms": 334.06379201915115}, "total_wall_ms": 27253.03216604516, "ttft_ms": 13.92537506762892, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "d61f6e4ba559b6ad599776ba1dde125886b7cce11359e052c543341aa80f3413", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ac465b052e171b7d8d3f7a8f", "attempt_id": "4be5fe683596", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:55.474944Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 234934272}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 42, "message_tokens": null, "message_utf8_bytes": 30528, "cache_tensor_bytes": 234934272, "serialized_payload_bytes": 234934272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1342.9936249740422, "ttft_ms": 91.66204195935279, "decode_ms": 107.14562493376434, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1556.7814169917256, "ttft_ms": 91.66204195935279, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8544550", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "7ea69da7ca13297bce5fac6a79b7f74d78548d728dc85a91c943d1c2c8172768"} | ||||
| 1114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "07aa59223e29e988f93aa7db", "attempt_id": "9e927a4653d0", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:55.707200Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 234934272}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 30528, "cache_tensor_bytes": 234934272, "serialized_payload_bytes": 234934272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1342.9936249740422, "ttft_ms": 70.51808305550367, "decode_ms": 153.04691600613296, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1570.7210829714313, "ttft_ms": 70.51808305550367, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XT-58M-1436", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "88a42ad8cf9f73f734996854479d027d426515d2bbd638fc89c418555a6c0484"} | ||||
| 1115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5551ce60610c502d84dd17e2", "attempt_id": "092c4fc4e327", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:55.953745Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 234934272}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 50, "message_tokens": null, "message_utf8_bytes": 30528, "cache_tensor_bytes": 234934272, "serialized_payload_bytes": 234934272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1342.9936249740422, "ttft_ms": 142.6464159740135, "decode_ms": 109.63470791466534, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1599.8131249798462, "ttft_ms": 142.6464159740135, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4135500", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "6b5630c7cd8c2ad9a5337e78631ba45cc68e9c5436ea5150720f9dd9bfb6efeb"} | ||||
| 1116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9e3cf9e4b91792eae7c44a4f", "attempt_id": "fbaee1ca560f", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:56.229371Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 234934272}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 45, "message_tokens": null, "message_utf8_bytes": 30528, "cache_tensor_bytes": 234934272, "serialized_payload_bytes": 234934272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1342.9936249740422, "ttft_ms": 64.21041709836572, "decode_ms": 109.11858303006738, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1520.5572079867125, "ttft_ms": 64.21041709836572, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7730705", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "6c885473fb45b44c6a425cd3cd307b4771e35351a0e2c17186a92d2de9c1fd42"} | ||||
| 1117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a9f19bec9b70a3208b67e289", "attempt_id": "2cb5e628ef41", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:56.425456Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 234934272}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 53, "message_tokens": null, "message_utf8_bytes": 30528, "cache_tensor_bytes": 234934272, "serialized_payload_bytes": 234934272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1342.9936249740422, "ttft_ms": 179.80724992230535, "decode_ms": 77.19920796807855, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1604.2816669214517, "ttft_ms": 179.80724992230535, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ixbanruk-3", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "1cc74509d5485de66115e1f6b591a4a84f89826fbba3b26cfbf7cfcfdc216bf5"} | ||||
| 1118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "291a5ac6c2bdf46d0313c81f", "attempt_id": "4afd92133ca5", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:56.706749Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 234934272}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30528, "cache_tensor_bytes": 234934272, "serialized_payload_bytes": 234934272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1342.9936249740422, "ttft_ms": 91.37199993710965, "decode_ms": 120.81383296754211, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1559.5775409601629, "ttft_ms": 91.37199993710965, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14046129", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "a94f4176f29077a3639f8b4b208d4df1aa5ce852107b8f35a82b6d893bda6400"} | ||||
| 1119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "91578b1197d85a4963d393f5", "attempt_id": "84c0321fc7a6", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:56.940753Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 234934272}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 48, "message_tokens": null, "message_utf8_bytes": 30528, "cache_tensor_bytes": 234934272, "serialized_payload_bytes": 234934272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1342.9936249740422, "ttft_ms": 79.1197499493137, "decode_ms": 15.385249978862703, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1442.24495801609, "ttft_ms": 79.1197499493137, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "04809f3c85b7ad048d24e129", "attempt_id": "2c405b129886", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:57.057621Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 234934272}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5790, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 30528, "cache_tensor_bytes": 234934272, "serialized_payload_bytes": 234934272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1342.9936249740422, "ttft_ms": 61.951917014084756, "decode_ms": 15.303834108635783, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1424.911041976884, "ttft_ms": 61.951917014084756, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Ostfel-3", "bogus_amount": "8,995,865", "source": "S4"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9876bb72d54e047ab9bfaf91", "attempt_id": "5bbfd502b67e", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:58.158623Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2327, "message_tokens": 2241, "message_utf8_bytes": 8132, "cache_tensor_bytes": null, "serialized_payload_bytes": 8132, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.031125033274292946, "ttft_ms": 13.891041977331042, "decode_ms": 123.77791607286781, "receiver_prefill_ms": 269.98145796824247}, "total_wall_ms": 411.2374170217663, "ttft_ms": 13.891041977331042, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,505,050", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "165eba437d60ab817b1f07a46115d2fdc9a94333061032c0fc3dda754aff54df", "output_hash": "ce50815ff9cdaab72b318f821f80a5ad96dc257c6df51048d6fd9c743b4157c6"} | ||||
| 1122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "47789b53c65f7a3c42d26010", "attempt_id": "1ed4118b2e4c", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:58.583426Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2328, "message_tokens": 2241, "message_utf8_bytes": 8132, "cache_tensor_bytes": null, "serialized_payload_bytes": 8132, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.031125033274292946, "ttft_ms": 13.706292025744915, "decode_ms": 148.4004999510944, "receiver_prefill_ms": 258.01016693003476}, "total_wall_ms": 423.7230410799384, "ttft_ms": 13.706292025744915, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "165eba437d60ab817b1f07a46115d2fdc9a94333061032c0fc3dda754aff54df", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 1123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "63e50dc187329bd703a76296", "attempt_id": "00dfa5fecad3", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:59.020857Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2335, "message_tokens": 2241, "message_utf8_bytes": 8132, "cache_tensor_bytes": null, "serialized_payload_bytes": 8132, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.031125033274292946, "ttft_ms": 13.389665982685983, "decode_ms": 122.2741660894826, "receiver_prefill_ms": 257.64349999371916}, "total_wall_ms": 396.9754580175504, "ttft_ms": 13.389665982685983, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,655,775", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "165eba437d60ab817b1f07a46115d2fdc9a94333061032c0fc3dda754aff54df", "output_hash": "5f09e362aca0b92ad7da0d7a80d5d1ab3c49651619aa4dad4d1e51c4087fde12"} | ||||
| 1124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b6032e93710af68214019ee0", "attempt_id": "febb8c627a4d", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:59.431601Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2326, "message_tokens": 2241, "message_utf8_bytes": 8132, "cache_tensor_bytes": null, "serialized_payload_bytes": 8132, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.031125033274292946, "ttft_ms": 13.73674999922514, "decode_ms": 94.26087501924485, "receiver_prefill_ms": 257.0220419438556}, "total_wall_ms": 368.54262510314584, "ttft_ms": 13.73674999922514, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6974845", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "165eba437d60ab817b1f07a46115d2fdc9a94333061032c0fc3dda754aff54df", "output_hash": "28cc9ebee1b3f7e803628a9d5fa8730b20a446620cf59ca3afb5fbf6cd001b1d"} | ||||
| 1125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "fee5bfeaa9aefec38869ade5", "attempt_id": "11b38d1bd9e3", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:25:59.813929Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2334, "message_tokens": 2241, "message_utf8_bytes": 8132, "cache_tensor_bytes": null, "serialized_payload_bytes": 8132, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.031125033274292946, "ttft_ms": 13.706458965316415, "decode_ms": 68.7168330186978, "receiver_prefill_ms": 258.1510409945622}, "total_wall_ms": 344.32387503329664, "ttft_ms": 13.706458965316415, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "165eba437d60ab817b1f07a46115d2fdc9a94333061032c0fc3dda754aff54df", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 1126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "faac501ba3177a87aab4c8a8", "attempt_id": "7c1018dc8220", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:00.171575Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2330, "message_tokens": 2241, "message_utf8_bytes": 8132, "cache_tensor_bytes": null, "serialized_payload_bytes": 8132, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.031125033274292946, "ttft_ms": 13.901834026910365, "decode_ms": 135.38845791481435, "receiver_prefill_ms": 258.445292012766}, "total_wall_ms": 411.3285830244422, "ttft_ms": 13.901834026910365, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "24,587,551", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "165eba437d60ab817b1f07a46115d2fdc9a94333061032c0fc3dda754aff54df", "output_hash": "2023eaa6b70ef24869eb7ff58a566e24b6fdb81ee00ac6a4fcb71cb6a57b2ce7"} | ||||
| 1127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8a8436b02e73d301b9602024", "attempt_id": "5c384a3d7971", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:00.597057Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2330, "message_tokens": 2241, "message_utf8_bytes": 8132, "cache_tensor_bytes": null, "serialized_payload_bytes": 8132, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.031125033274292946, "ttft_ms": 13.678541989065707, "decode_ms": 13.425040990114212, "receiver_prefill_ms": 257.3885830352083}, "total_wall_ms": 287.9697079770267, "ttft_ms": 13.678541989065707, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "165eba437d60ab817b1f07a46115d2fdc9a94333061032c0fc3dda754aff54df", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "88dd302b07d06f73fda012a1", "attempt_id": "df3bd4d8ab8a", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:00.899503Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2332, "message_tokens": 2241, "message_utf8_bytes": 8132, "cache_tensor_bytes": null, "serialized_payload_bytes": 8132, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.031125033274292946, "ttft_ms": 13.64029198884964, "decode_ms": 13.615750009194016, "receiver_prefill_ms": 257.90862494613975}, "total_wall_ms": 288.8340000063181, "ttft_ms": 13.64029198884964, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "165eba437d60ab817b1f07a46115d2fdc9a94333061032c0fc3dda754aff54df", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ddf596fa68a398f0b20147c9", "attempt_id": "fd3f8461fb19", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:15.278300Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1125, "message_tokens": 1037, "message_utf8_bytes": 2464, "cache_tensor_bytes": null, "serialized_payload_bytes": 2464, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14076.079874997959, "ttft_ms": 13.453082996420562, "decode_ms": 121.43866694532335, "receiver_prefill_ms": 121.597999939695}, "total_wall_ms": 14334.436457953416, "ttft_ms": 13.453082996420562, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,505,050", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "27038d9bff3c879c939b89b7ea5d25a4c137081173a39d93ac66531bf735bf88", "output_hash": "ce50815ff9cdaab72b318f821f80a5ad96dc257c6df51048d6fd9c743b4157c6"} | ||||
| 1130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "91dc128f2de9767a07332616", "attempt_id": "34e76b6361f4", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:15.551236Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1126, "message_tokens": 1037, "message_utf8_bytes": 2464, "cache_tensor_bytes": null, "serialized_payload_bytes": 2464, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14076.079874997959, "ttft_ms": 13.444541953504086, "decode_ms": 148.56674999464303, "receiver_prefill_ms": 121.53533298987895}, "total_wall_ms": 14361.460041021928, "ttft_ms": 13.444541953504086, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "27038d9bff3c879c939b89b7ea5d25a4c137081173a39d93ac66531bf735bf88", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 1131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c1189560c1ddcbbf3762c9a8", "attempt_id": "41c1c71ca063", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:15.850679Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1133, "message_tokens": 1037, "message_utf8_bytes": 2464, "cache_tensor_bytes": null, "serialized_payload_bytes": 2464, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14076.079874997959, "ttft_ms": 13.475790969096124, "decode_ms": 94.30174995213747, "receiver_prefill_ms": 121.63637496996671}, "total_wall_ms": 14307.325958041474, "ttft_ms": 13.475790969096124, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4655775", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "27038d9bff3c879c939b89b7ea5d25a4c137081173a39d93ac66531bf735bf88", "output_hash": "b7861433980fb1fe1626f95887719df5e18c1ad310548d7311301fbb11cb9171"} | ||||
| 1132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1b9296a6414a748f3393b7d0", "attempt_id": "21fa5ee3c914", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:16.095831Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1124, "message_tokens": 1037, "message_utf8_bytes": 2464, "cache_tensor_bytes": null, "serialized_payload_bytes": 2464, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14076.079874997959, "ttft_ms": 13.532208045944571, "decode_ms": 93.80483301356435, "receiver_prefill_ms": 120.72929204441607}, "total_wall_ms": 14305.946832988411, "ttft_ms": 13.532208045944571, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6974845", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "27038d9bff3c879c939b89b7ea5d25a4c137081173a39d93ac66531bf735bf88", "output_hash": "28cc9ebee1b3f7e803628a9d5fa8730b20a446620cf59ca3afb5fbf6cd001b1d"} | ||||
| 1133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c2a5dada9268850e76feaa42", "attempt_id": "0523cf6ad121", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:16.339712Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1132, "message_tokens": 1037, "message_utf8_bytes": 2464, "cache_tensor_bytes": null, "serialized_payload_bytes": 2464, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14076.079874997959, "ttft_ms": 13.550624949857593, "decode_ms": 55.206999997608364, "receiver_prefill_ms": 121.23470904771239}, "total_wall_ms": 14268.301084055565, "ttft_ms": 13.550624949857593, "input_usage": {}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quital-3", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "27038d9bff3c879c939b89b7ea5d25a4c137081173a39d93ac66531bf735bf88", "output_hash": "afbf4910f8901622fd15b86baf53c5a654cecf1e73ba179354f34a3e6df66253"} | ||||
| 1134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d99c266d00b763774b0ccbc1", "attempt_id": "127846a73c4b", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:16.546423Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1128, "message_tokens": 1037, "message_utf8_bytes": 2464, "cache_tensor_bytes": null, "serialized_payload_bytes": 2464, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14076.079874997959, "ttft_ms": 13.945249957032502, "decode_ms": 134.72279103007168, "receiver_prefill_ms": 121.09899998176843}, "total_wall_ms": 14347.741791978478, "ttft_ms": 13.945249957032502, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15,108,595", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "27038d9bff3c879c939b89b7ea5d25a4c137081173a39d93ac66531bf735bf88", "output_hash": "b62b0617a027f1f669aac2ed1075f7173d5ad558a25d4fd4495d7ccd886f4122"} | ||||
| 1135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8c7d2dcbb15a0bcce0e6d96a", "attempt_id": "fe6924cfdb64", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:16.831983Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1128, "message_tokens": 1037, "message_utf8_bytes": 2464, "cache_tensor_bytes": null, "serialized_payload_bytes": 2464, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14076.079874997959, "ttft_ms": 13.486167066730559, "decode_ms": 13.617207994684577, "receiver_prefill_ms": 121.70170806348324}, "total_wall_ms": 14226.7588339746, "ttft_ms": 13.486167066730559, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "27038d9bff3c879c939b89b7ea5d25a4c137081173a39d93ac66531bf735bf88", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2f4b96312b7eb2676853fecc", "attempt_id": "7ba7cb9507d8", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:16.996827Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1130, "message_tokens": 1037, "message_utf8_bytes": 2464, "cache_tensor_bytes": null, "serialized_payload_bytes": 2464, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14076.079874997959, "ttft_ms": 13.535708072595298, "decode_ms": 13.184332987293601, "receiver_prefill_ms": 121.57137505710125}, "total_wall_ms": 14226.264083990827, "ttft_ms": 13.535708072595298, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "27038d9bff3c879c939b89b7ea5d25a4c137081173a39d93ac66531bf735bf88", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "60d6432e3e42f1cb4ad470bd", "attempt_id": "1c1c97a19d01", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:28.464802Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 492, "message_utf8_bytes": 1319, "cache_tensor_bytes": null, "serialized_payload_bytes": 1319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11303.13858401496, "ttft_ms": 13.166208984330297, "decode_ms": 13.420666917227209, "receiver_prefill_ms": 69.48766601271927}, "total_wall_ms": 11401.299125980586, "ttft_ms": 13.166208984330297, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "90cd220d5cde6ca36734c9346279ef63919ef90f4f02b03c24c3e105ae002674", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c11e8e46d605f1fc1784dac4", "attempt_id": "1e46636414bd", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:28.577425Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 584, "message_tokens": 492, "message_utf8_bytes": 1319, "cache_tensor_bytes": null, "serialized_payload_bytes": 1319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11303.13858401496, "ttft_ms": 13.473708997480571, "decode_ms": 13.729624915868044, "receiver_prefill_ms": 69.00283298455179}, "total_wall_ms": 11400.619875988923, "ttft_ms": 13.473708997480571, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "90cd220d5cde6ca36734c9346279ef63919ef90f4f02b03c24c3e105ae002674", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ced908c087475b77ef2ede90", "attempt_id": "8357dec00d8e", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:28.689004Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 591, "message_tokens": 492, "message_utf8_bytes": 1319, "cache_tensor_bytes": null, "serialized_payload_bytes": 1319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11303.13858401496, "ttft_ms": 13.383334036916494, "decode_ms": 13.373541994951665, "receiver_prefill_ms": 69.56508290022612}, "total_wall_ms": 11400.67116706632, "ttft_ms": 13.383334036916494, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "90cd220d5cde6ca36734c9346279ef63919ef90f4f02b03c24c3e105ae002674", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2546603395602a4c2173f5ba", "attempt_id": "54818d856a3c", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:28.800779Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 582, "message_tokens": 492, "message_utf8_bytes": 1319, "cache_tensor_bytes": null, "serialized_payload_bytes": 1319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11303.13858401496, "ttft_ms": 13.223040965385735, "decode_ms": 92.68841589801013, "receiver_prefill_ms": 69.00087499525398}, "total_wall_ms": 11479.26983400248, "ttft_ms": 13.223040965385735, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "90cd220d5cde6ca36734c9346279ef63919ef90f4f02b03c24c3e105ae002674", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | ||||
| 1141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5c10d75f2518468176cd5a8e", "attempt_id": "770fc02d0a69", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:28.990956Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 492, "message_utf8_bytes": 1319, "cache_tensor_bytes": null, "serialized_payload_bytes": 1319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11303.13858401496, "ttft_ms": 13.810208067297935, "decode_ms": 52.675665938295424, "receiver_prefill_ms": 69.00245801080018}, "total_wall_ms": 11439.839833998121, "ttft_ms": 13.810208067297935, "input_usage": {}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quital-3", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "90cd220d5cde6ca36734c9346279ef63919ef90f4f02b03c24c3e105ae002674", "output_hash": "afbf4910f8901622fd15b86baf53c5a654cecf1e73ba179354f34a3e6df66253"} | ||||
| 1142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8fbbb8f2a0432fcd9974bc45", "attempt_id": "e27295d8463f", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:29.141881Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 586, "message_tokens": 492, "message_utf8_bytes": 1319, "cache_tensor_bytes": null, "serialized_payload_bytes": 1319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11303.13858401496, "ttft_ms": 13.841875013895333, "decode_ms": 106.68595798779279, "receiver_prefill_ms": 69.47837502229959}, "total_wall_ms": 11494.38387597911, "ttft_ms": 13.841875013895333, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10509125", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "90cd220d5cde6ca36734c9346279ef63919ef90f4f02b03c24c3e105ae002674", "output_hash": "28f1d1171bdf58f57971a293e7fcba893f349d43f16479dc116111e3188a7144"} | ||||
| 1143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6ea995929108ea3f5b88fbc2", "attempt_id": "e8125c6d3476", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:29.347381Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 586, "message_tokens": 492, "message_utf8_bytes": 1319, "cache_tensor_bytes": null, "serialized_payload_bytes": 1319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11303.13858401496, "ttft_ms": 13.503707945346832, "decode_ms": 13.431500061415136, "receiver_prefill_ms": 69.36870806384832}, "total_wall_ms": 11400.663334061392, "ttft_ms": 13.503707945346832, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "90cd220d5cde6ca36734c9346279ef63919ef90f4f02b03c24c3e105ae002674", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f2e214ed4ef0ce0e8045cc27", "attempt_id": "56f3a911850a", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:29.458789Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 588, "message_tokens": 492, "message_utf8_bytes": 1319, "cache_tensor_bytes": null, "serialized_payload_bytes": 1319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11303.13858401496, "ttft_ms": 13.568124966695905, "decode_ms": 13.532124925404787, "receiver_prefill_ms": 69.30270907469094}, "total_wall_ms": 11400.780500960536, "ttft_ms": 13.568124966695905, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "90cd220d5cde6ca36734c9346279ef63919ef90f4f02b03c24c3e105ae002674", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "fc5184d340806ff0fc332c02", "attempt_id": "cc1cc0a77aa3", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:40.849816Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1228, "message_tokens": 1138, "message_utf8_bytes": 2942, "cache_tensor_bytes": null, "serialized_payload_bytes": 2942, "side_information_bytes": 0, "fetched_bytes": 1605, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11279.119875049219, "ttft_ms": 13.484333991073072, "decode_ms": 13.46104103140533, "receiver_prefill_ms": 128.72649997007102}, "total_wall_ms": 11436.806124984287, "ttft_ms": 13.484333991073072, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "7114c15317d01d85402a4a21c9de71c8e585cae3394de5825f03783370ca7d49", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "17eb741a2c682597964375d5", "attempt_id": "bbba5f686299", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:41.022056Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1194, "message_tokens": 1103, "message_utf8_bytes": 2887, "cache_tensor_bytes": null, "serialized_payload_bytes": 2887, "side_information_bytes": 0, "fetched_bytes": 1539, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11279.119875049219, "ttft_ms": 13.465374941006303, "decode_ms": 13.417166075669229, "receiver_prefill_ms": 127.0954170031473}, "total_wall_ms": 11435.040250071324, "ttft_ms": 13.465374941006303, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "5e5d699257a4a35908d96ed77d3043a3d9d5745f8c4fbb334caeae7ebc75ed49", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5fc5166bc5bd9edd612ded9d", "attempt_id": "739be6023545", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:41.192190Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1236, "message_tokens": 1138, "message_utf8_bytes": 2942, "cache_tensor_bytes": null, "serialized_payload_bytes": 2942, "side_information_bytes": 0, "fetched_bytes": 1605, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11279.119875049219, "ttft_ms": 13.50754196755588, "decode_ms": 95.48512496985495, "receiver_prefill_ms": 128.54058295488358}, "total_wall_ms": 11518.71974999085, "ttft_ms": 13.50754196755588, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4655775", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a72cdd7d338f2a4a7d122a14205b59afa2ea733892d028a5e5ad386727b36ac0", "output_hash": "b7861433980fb1fe1626f95887719df5e18c1ad310548d7311301fbb11cb9171"} | ||||
| 1148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "317a948d43bafa8a4edb3fc5", "attempt_id": "3bdc831292cc", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:41.446403Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1227, "message_tokens": 1138, "message_utf8_bytes": 2942, "cache_tensor_bytes": null, "serialized_payload_bytes": 2942, "side_information_bytes": 0, "fetched_bytes": 1605, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11279.119875049219, "ttft_ms": 13.648167019709945, "decode_ms": 94.78899999521673, "receiver_prefill_ms": 128.2340829493478}, "total_wall_ms": 11517.962042125873, "ttft_ms": 13.648167019709945, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ed231bef830df9e63d3c316d92d57b1c2ba31daf1fa13d3f76f6b51c9e239568", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | ||||
| 1149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "993eb1f6e0ee3b1a60872fe8", "attempt_id": "6a635ad51156", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:41.700850Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1223, "message_tokens": 1126, "message_utf8_bytes": 2935, "cache_tensor_bytes": null, "serialized_payload_bytes": 2935, "side_information_bytes": 0, "fetched_bytes": 1597, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11279.119875049219, "ttft_ms": 13.721292023546994, "decode_ms": 66.73220894299448, "receiver_prefill_ms": 127.96512502245605}, "total_wall_ms": 11489.490084117278, "ttft_ms": 13.721292023546994, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Project Kovar-9", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "364ec93fc6647db193b94745597166a50ad17690ead3a316de6b9053f4f604d8", "output_hash": "ba9eb7d7e7e2ba2e01e022d7883eb6c4146ddc97ec6cf76ef4e65473620e0e77"} | ||||
| 1150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a8b2e5a20f4386fc77bd9919", "attempt_id": "8915492ba916", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:41.925778Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1231, "message_tokens": 1138, "message_utf8_bytes": 2942, "cache_tensor_bytes": null, "serialized_payload_bytes": 2942, "side_information_bytes": 0, "fetched_bytes": 1605, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11279.119875049219, "ttft_ms": 13.43724993057549, "decode_ms": 107.23004199098796, "receiver_prefill_ms": 128.40429204516113}, "total_wall_ms": 11530.154917039908, "ttft_ms": 13.43724993057549, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10316180", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c4bcdb3b919a3185099769ae04a17e7902f26e851768dc04ecf302667b5ac434", "output_hash": "219c5eba6a4c4a04e8e34eb92bdadda23439f54f46f125860a51606ab0da82a6"} | ||||
| 1151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c040ea6f62dfd3f212f58b9c", "attempt_id": "5510da5c0b6f", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:42.191469Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1213, "message_tokens": 1120, "message_utf8_bytes": 2940, "cache_tensor_bytes": null, "serialized_payload_bytes": 2940, "side_information_bytes": 0, "fetched_bytes": 1590, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11279.119875049219, "ttft_ms": 13.619291945360601, "decode_ms": 13.252875069156289, "receiver_prefill_ms": 127.40220804698765}, "total_wall_ms": 11435.405625030398, "ttft_ms": 13.619291945360601, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "fa008cabcd1ee371ede262f2acf1ca7a3771003f48caa6ea61f69de33221ab0b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f247a65b1bb4e3b52b811968", "attempt_id": "8afcc1b0ace9", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:42.362054Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1233, "message_tokens": 1138, "message_utf8_bytes": 2942, "cache_tensor_bytes": null, "serialized_payload_bytes": 2942, "side_information_bytes": 0, "fetched_bytes": 1605, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 11279.119875049219, "ttft_ms": 13.65391700528562, "decode_ms": 13.530874974094331, "receiver_prefill_ms": 128.1990420538932}, "total_wall_ms": 11436.461750068702, "ttft_ms": 13.65391700528562, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "7114c15317d01d85402a4a21c9de71c8e585cae3394de5825f03783370ca7d49", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8536abea44c1c5ad8ef418a0", "attempt_id": "75e3956884dc", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:42.801223Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 85487616}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 8106, "cache_tensor_bytes": 85487616, "serialized_payload_bytes": 85487616, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 267.29420898482203, "ttft_ms": 30.090500018559396, "decode_ms": 125.79962494783103, "receiver_prefill_ms": 0.0}, "total_wall_ms": 427.5292919483036, "ttft_ms": 30.090500018559396, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,505,050", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "ce50815ff9cdaab72b318f821f80a5ad96dc257c6df51048d6fd9c743b4157c6"} | ||||
| 1154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "331f85d9f0a1ecca8d2e9df5", "attempt_id": "4d5854bbd38e", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:42.975660Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 85487616}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 45, "message_tokens": null, "message_utf8_bytes": 8106, "cache_tensor_bytes": 85487616, "serialized_payload_bytes": 85487616, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 267.29420898482203, "ttft_ms": 27.15362492017448, "decode_ms": 138.73183296527714, "receiver_prefill_ms": 0.0}, "total_wall_ms": 437.05733388196677, "ttft_ms": 27.15362492017448, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NJ-83E-8738", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "221cb023a964476f081fadfc6302fcebc6235ba5bc056d90a62ab7434c3df4f2"} | ||||
| 1155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c2ee9a00b3eb28003cc78183", "attempt_id": "f2eaae7074e5", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:43.160168Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 85487616}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 52, "message_tokens": null, "message_utf8_bytes": 8106, "cache_tensor_bytes": 85487616, "serialized_payload_bytes": 85487616, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 267.29420898482203, "ttft_ms": 28.124416014179587, "decode_ms": 97.26916695944965, "receiver_prefill_ms": 0.0}, "total_wall_ms": 396.831416990608, "ttft_ms": 28.124416014179587, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4655775", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b7861433980fb1fe1626f95887719df5e18c1ad310548d7311301fbb11cb9171"} | ||||
| 1156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "cd12c9793a8d97bef894f950", "attempt_id": "a0160d1e8bef", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:43.304330Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 85487616}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 43, "message_tokens": null, "message_utf8_bytes": 8106, "cache_tensor_bytes": 85487616, "serialized_payload_bytes": 85487616, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 267.29420898482203, "ttft_ms": 28.347707935608923, "decode_ms": 97.07549994345754, "receiver_prefill_ms": 0.0}, "total_wall_ms": 396.6988760512322, "ttft_ms": 28.347707935608923, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6974845", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "28cc9ebee1b3f7e803628a9d5fa8730b20a446620cf59ca3afb5fbf6cd001b1d"} | ||||
| 1157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f118dc4d16f74dbad2cbc93a", "attempt_id": "8ba1ceeb8692", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:43.448054Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 85487616}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 51, "message_tokens": null, "message_utf8_bytes": 8106, "cache_tensor_bytes": 85487616, "serialized_payload_bytes": 85487616, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 267.29420898482203, "ttft_ms": 27.80191705096513, "decode_ms": 55.52512500435114, "receiver_prefill_ms": 0.0}, "total_wall_ms": 354.4746679253876, "ttft_ms": 27.80191705096513, "input_usage": {}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quital-3", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "afbf4910f8901622fd15b86baf53c5a654cecf1e73ba179354f34a3e6df66253"} | ||||
| 1158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a85a7e2d5269c8b9a2f6bfff", "attempt_id": "41e81f6d6fba", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:43.549794Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 85487616}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 8106, "cache_tensor_bytes": 85487616, "serialized_payload_bytes": 85487616, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 267.29420898482203, "ttft_ms": 27.131790993735194, "decode_ms": 125.32545800786465, "receiver_prefill_ms": 0.0}, "total_wall_ms": 423.7302510300651, "ttft_ms": 27.131790993735194, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12589.061", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "79d41e7dd4899f3b26e4e55554b519e8be5fd62a13e57fd58b3992bf122f15d0"} | ||||
| 1159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d4a9ddbef2189c74e03ab0fe", "attempt_id": "8e17feb09ae5", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:43.720262Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 85487616}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 8106, "cache_tensor_bytes": 85487616, "serialized_payload_bytes": 85487616, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 267.29420898482203, "ttft_ms": 27.261874987743795, "decode_ms": 14.126416062936187, "receiver_prefill_ms": 0.0}, "total_wall_ms": 312.3641669517383, "ttft_ms": 27.261874987743795, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "33c4f0a28e4ffc34c09c4946", "attempt_id": "37b1ecad1d8a", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:43.779450Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 85487616}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 8106, "cache_tensor_bytes": 85487616, "serialized_payload_bytes": 85487616, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 267.29420898482203, "ttft_ms": 25.328415911644697, "decode_ms": 13.97900003939867, "receiver_prefill_ms": 0.0}, "total_wall_ms": 310.57095900177956, "ttft_ms": 25.328415911644697, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "24d8d45a2464ba6f4a8a8380", "attempt_id": "9f5f5deaf39d", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:43.837239Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2441, "message_tokens": 2355, "message_utf8_bytes": 8636, "cache_tensor_bytes": null, "serialized_payload_bytes": 8636, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.027417088858783245, "ttft_ms": 13.507958967238665, "decode_ms": 121.46545900031924, "receiver_prefill_ms": 269.13987507577986}, "total_wall_ms": 407.9107081051916, "ttft_ms": 13.507958967238665, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,505,050", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6f7e54724fbe954c4046c548a8cdd636a01ba04e8c9b78d76cd806a2876e5f4d", "output_hash": "ce50815ff9cdaab72b318f821f80a5ad96dc257c6df51048d6fd9c743b4157c6"} | ||||
| 1162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "dc1b2b822efa65503921abf8", "attempt_id": "a7b769852cc9", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:44.259596Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2442, "message_tokens": 2355, "message_utf8_bytes": 8636, "cache_tensor_bytes": null, "serialized_payload_bytes": 8636, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.027417088858783245, "ttft_ms": 14.074707985855639, "decode_ms": 149.0085000405088, "receiver_prefill_ms": 269.9879170395434}, "total_wall_ms": 436.8310001445934, "ttft_ms": 14.074707985855639, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6f7e54724fbe954c4046c548a8cdd636a01ba04e8c9b78d76cd806a2876e5f4d", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 1163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e1dfd735e71eb5329ba87313", "attempt_id": "d248d83bab3c", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:44.710756Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2449, "message_tokens": 2355, "message_utf8_bytes": 8636, "cache_tensor_bytes": null, "serialized_payload_bytes": 8636, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.027417088858783245, "ttft_ms": 13.436875073239207, "decode_ms": 96.2450000224635, "receiver_prefill_ms": 268.2500840164721}, "total_wall_ms": 381.8036251468584, "ttft_ms": 13.436875073239207, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4655775", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6f7e54724fbe954c4046c548a8cdd636a01ba04e8c9b78d76cd806a2876e5f4d", "output_hash": "b7861433980fb1fe1626f95887719df5e18c1ad310548d7311301fbb11cb9171"} | ||||
| 1164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "103a74ace7e434c06c387adb", "attempt_id": "8547f98e41d3", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:45.106839Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2440, "message_tokens": 2355, "message_utf8_bytes": 8636, "cache_tensor_bytes": null, "serialized_payload_bytes": 8636, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.027417088858783245, "ttft_ms": 13.761833077296615, "decode_ms": 120.85820897482336, "receiver_prefill_ms": 268.30200001131743}, "total_wall_ms": 406.6082091303542, "ttft_ms": 13.761833077296615, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,663,695", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6f7e54724fbe954c4046c548a8cdd636a01ba04e8c9b78d76cd806a2876e5f4d", "output_hash": "8a8c707b1b5795e347ee48f254989477cc20a872192b710ac34c4cf564f0effa"} | ||||
| 1165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "25f137ca67a2e0afd6c45f62", "attempt_id": "56a5e9651b41", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:45.527797Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2448, "message_tokens": 2355, "message_utf8_bytes": 8636, "cache_tensor_bytes": null, "serialized_payload_bytes": 8636, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.027417088858783245, "ttft_ms": 13.41895794030279, "decode_ms": 68.19254206493497, "receiver_prefill_ms": 267.7704159868881}, "total_wall_ms": 353.0967920087278, "ttft_ms": 13.41895794030279, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6f7e54724fbe954c4046c548a8cdd636a01ba04e8c9b78d76cd806a2876e5f4d", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 1166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ab7ca2aceff12932acbb9272", "attempt_id": "51e0a05c863c", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:45.894682Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2444, "message_tokens": 2355, "message_utf8_bytes": 8636, "cache_tensor_bytes": null, "serialized_payload_bytes": 8636, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.027417088858783245, "ttft_ms": 13.580249971710145, "decode_ms": 135.38854091893882, "receiver_prefill_ms": 268.083417089656}, "total_wall_ms": 420.71350011974573, "ttft_ms": 13.580249971710145, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20,904,045", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6f7e54724fbe954c4046c548a8cdd636a01ba04e8c9b78d76cd806a2876e5f4d", "output_hash": "32d189add228da1299c5d4903d642547467dbe76ab1fa46a08fe399c77b124a4"} | ||||
| 1167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5f87e52442773dad365a0fa7", "attempt_id": "d21e1a8e39aa", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:46.329265Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2444, "message_tokens": 2355, "message_utf8_bytes": 8636, "cache_tensor_bytes": null, "serialized_payload_bytes": 8636, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.027417088858783245, "ttft_ms": 13.551541953347623, "decode_ms": 13.78725003451109, "receiver_prefill_ms": 268.2530829915777}, "total_wall_ms": 299.3497920688242, "ttft_ms": 13.551541953347623, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6f7e54724fbe954c4046c548a8cdd636a01ba04e8c9b78d76cd806a2876e5f4d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4f728cc2776a251615188c8e", "attempt_id": "156e6db27b70", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:26:46.642770Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2446, "message_tokens": 2355, "message_utf8_bytes": 8636, "cache_tensor_bytes": null, "serialized_payload_bytes": 8636, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.027417088858783245, "ttft_ms": 14.309375081211329, "decode_ms": 13.499709079042077, "receiver_prefill_ms": 274.38479103147984}, "total_wall_ms": 305.89258403051645, "ttft_ms": 14.309375081211329, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6f7e54724fbe954c4046c548a8cdd636a01ba04e8c9b78d76cd806a2876e5f4d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "23cc30348a07c53a933d9a62", "attempt_id": "a5e2ff469b87", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:08.896800Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1609}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1721, "message_tokens": 1634, "message_utf8_bytes": 5352, "cache_tensor_bytes": null, "serialized_payload_bytes": 5352, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 21932.983916951343, "ttft_ms": 13.465541996993124, "decode_ms": 13.449708931148052, "receiver_prefill_ms": 180.3730420069769}, "total_wall_ms": 22142.98708399292, "ttft_ms": 13.465541996993124, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a9cebf682785dc94dcdd0b202cacb245202933c222fc8019994325a1c059ab6f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e72aa891a124aa58ac4c0928", "attempt_id": "840af03861ca", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:09.121458Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1609}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1722, "message_tokens": 1634, "message_utf8_bytes": 5352, "cache_tensor_bytes": null, "serialized_payload_bytes": 5352, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 21932.983916951343, "ttft_ms": 13.318500015884638, "decode_ms": 149.10033298656344, "receiver_prefill_ms": 180.86291593499482}, "total_wall_ms": 22278.976499917917, "ttft_ms": 13.318500015884638, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a9cebf682785dc94dcdd0b202cacb245202933c222fc8019994325a1c059ab6f", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 1171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "220b86f6643f21ce9d12c2cc", "attempt_id": "9ceb4fee8201", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:09.482028Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1609}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1729, "message_tokens": 1634, "message_utf8_bytes": 5352, "cache_tensor_bytes": null, "serialized_payload_bytes": 5352, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 21932.983916951343, "ttft_ms": 13.54116597212851, "decode_ms": 94.4544579833746, "receiver_prefill_ms": 178.54995804373175}, "total_wall_ms": 22222.239958005957, "ttft_ms": 13.54116597212851, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4655775", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a9cebf682785dc94dcdd0b202cacb245202933c222fc8019994325a1c059ab6f", "output_hash": "b7861433980fb1fe1626f95887719df5e18c1ad310548d7311301fbb11cb9171"} | ||||
| 1172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "df8d23de959c6adea9819b4c", "attempt_id": "355f7e8f6990", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:09.785699Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1609}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1720, "message_tokens": 1634, "message_utf8_bytes": 5352, "cache_tensor_bytes": null, "serialized_payload_bytes": 5352, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 21932.983916951343, "ttft_ms": 13.834208017215133, "decode_ms": 123.22387506719679, "receiver_prefill_ms": 179.7703750198707}, "total_wall_ms": 22252.690541907214, "ttft_ms": 13.834208017215133, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,974,845", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a9cebf682785dc94dcdd0b202cacb245202933c222fc8019994325a1c059ab6f", "output_hash": "79a7909b232c25342aa43beb14828205efddf9ba169e9a4732be6f886b0465ec"} | ||||
| 1173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "cefcd6bc17382eab746f39c2", "attempt_id": "7ed56389dfc9", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:10.119952Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1609}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1728, "message_tokens": 1634, "message_utf8_bytes": 5352, "cache_tensor_bytes": null, "serialized_payload_bytes": 5352, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 21932.983916951343, "ttft_ms": 13.83949990849942, "decode_ms": 68.18979198578745, "receiver_prefill_ms": 179.76520804222673}, "total_wall_ms": 22197.576125035994, "ttft_ms": 13.83949990849942, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a9cebf682785dc94dcdd0b202cacb245202933c222fc8019994325a1c059ab6f", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 1174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ed4140b1abfb70324476ea06", "attempt_id": "bbb294cb4b57", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:10.398937Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1609}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1724, "message_tokens": 1634, "message_utf8_bytes": 5352, "cache_tensor_bytes": null, "serialized_payload_bytes": 5352, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 21932.983916951343, "ttft_ms": 13.806959032081068, "decode_ms": 110.50708300899714, "receiver_prefill_ms": 180.76266604475677}, "total_wall_ms": 22240.936708985828, "ttft_ms": 13.806959032081068, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11409075", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a9cebf682785dc94dcdd0b202cacb245202933c222fc8019994325a1c059ab6f", "output_hash": "5680edae8490840b49ab8e0f8f5363dd0d771f952818cb662d87507cc880b004"} | ||||
| 1175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3c48ad5c526ab678b056c82b", "attempt_id": "e60d67f5dda4", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:10.721802Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1609}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1724, "message_tokens": 1634, "message_utf8_bytes": 5352, "cache_tensor_bytes": null, "serialized_payload_bytes": 5352, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 21932.983916951343, "ttft_ms": 13.79187498241663, "decode_ms": 13.996249996125698, "receiver_prefill_ms": 188.08466591872275}, "total_wall_ms": 22151.78012487013, "ttft_ms": 13.79187498241663, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a9cebf682785dc94dcdd0b202cacb245202933c222fc8019994325a1c059ab6f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ac91751551322354f8fe9180", "attempt_id": "a8e0bf339723", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:10.955369Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1609}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1726, "message_tokens": 1634, "message_utf8_bytes": 5352, "cache_tensor_bytes": null, "serialized_payload_bytes": 5352, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 21932.983916951343, "ttft_ms": 13.83866707328707, "decode_ms": 13.533624936826527, "receiver_prefill_ms": 198.73916695360094}, "total_wall_ms": 22161.949749919586, "ttft_ms": 13.83866707328707, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a9cebf682785dc94dcdd0b202cacb245202933c222fc8019994325a1c059ab6f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "647778e2cbfc1939f6a66f7c", "attempt_id": "db31bf3d8512", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:39.250892Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1323, "message_tokens": 1232, "message_utf8_bytes": 3205, "cache_tensor_bytes": null, "serialized_payload_bytes": 3205, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28050.821875105612, "ttft_ms": 14.039249974302948, "decode_ms": 14.053374994546175, "receiver_prefill_ms": 848.9324999973178}, "total_wall_ms": 28930.883833090775, "ttft_ms": 14.039249974302948, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0aab8a264fc2c9db61fe90748315b3a43cd278e4e07289df1501836a0af8d584", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "64a23da0eaa11c5491121f34", "attempt_id": "2bf3af816dbb", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:40.147582Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1324, "message_tokens": 1232, "message_utf8_bytes": 3205, "cache_tensor_bytes": null, "serialized_payload_bytes": 3205, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28050.821875105612, "ttft_ms": 14.019499998539686, "decode_ms": 154.2368340305984, "receiver_prefill_ms": 143.91250000335276}, "total_wall_ms": 28365.08995911572, "ttft_ms": 14.019499998539686, "input_usage": {}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0aab8a264fc2c9db61fe90748315b3a43cd278e4e07289df1501836a0af8d584", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 1179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b5e5c739369b00dff284046a", "attempt_id": "5f47f739ca83", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:40.486546Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1331, "message_tokens": 1232, "message_utf8_bytes": 3205, "cache_tensor_bytes": null, "serialized_payload_bytes": 3205, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28050.821875105612, "ttft_ms": 13.506375020369887, "decode_ms": 122.74954200256616, "receiver_prefill_ms": 143.66587495896965}, "total_wall_ms": 28332.861917093396, "ttft_ms": 13.506375020369887, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,655,775", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0aab8a264fc2c9db61fe90748315b3a43cd278e4e07289df1501836a0af8d584", "output_hash": "5f09e362aca0b92ad7da0d7a80d5d1ab3c49651619aa4dad4d1e51c4087fde12"} | ||||
| 1180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "08aca3b52fca8e661b1bbcdc", "attempt_id": "5d1f439693b9", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:40.783237Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1322, "message_tokens": 1232, "message_utf8_bytes": 3205, "cache_tensor_bytes": null, "serialized_payload_bytes": 3205, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28050.821875105612, "ttft_ms": 13.521000044420362, "decode_ms": 121.39245797879994, "receiver_prefill_ms": 142.92891591321677}, "total_wall_ms": 28330.688083078712, "ttft_ms": 13.521000044420362, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,655,775", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0aab8a264fc2c9db61fe90748315b3a43cd278e4e07289df1501836a0af8d584", "output_hash": "5f09e362aca0b92ad7da0d7a80d5d1ab3c49651619aa4dad4d1e51c4087fde12"} | ||||
| 1181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9e2a34cc7083c8ed1b0608bf", "attempt_id": "c5f4f6cfb3ed", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:41.077393Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1330, "message_tokens": 1232, "message_utf8_bytes": 3205, "cache_tensor_bytes": null, "serialized_payload_bytes": 3205, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28050.821875105612, "ttft_ms": 14.32404201477766, "decode_ms": 68.85029096156359, "receiver_prefill_ms": 144.644416985102}, "total_wall_ms": 28280.87541612331, "ttft_ms": 14.32404201477766, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0aab8a264fc2c9db61fe90748315b3a43cd278e4e07289df1501836a0af8d584", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 1182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5df51f1c478dfa942d89340d", "attempt_id": "a87cdeb78183", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:41.322729Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1326, "message_tokens": 1232, "message_utf8_bytes": 3205, "cache_tensor_bytes": null, "serialized_payload_bytes": 3205, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28050.821875105612, "ttft_ms": 13.523042085580528, "decode_ms": 95.21950001362711, "receiver_prefill_ms": 142.82829104922712}, "total_wall_ms": 28304.46691601537, "ttft_ms": 13.523042085580528, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1898711", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0aab8a264fc2c9db61fe90748315b3a43cd278e4e07289df1501836a0af8d584", "output_hash": "b4fe81063d0e205df4e89ead86b3c3d00d7c5d7d66c75749c9c70ec804cc00e8"} | ||||
| 1183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e59fb37f832e16639d8fd8a3", "attempt_id": "83c38a2fa568", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:41.590833Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1326, "message_tokens": 1232, "message_utf8_bytes": 3205, "cache_tensor_bytes": null, "serialized_payload_bytes": 3205, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28050.821875105612, "ttft_ms": 13.563540996983647, "decode_ms": 13.63058399874717, "receiver_prefill_ms": 142.58133410476148}, "total_wall_ms": 28222.62454207521, "ttft_ms": 13.563540996983647, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0aab8a264fc2c9db61fe90748315b3a43cd278e4e07289df1501836a0af8d584", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b522e7107c9f72ff5c34c5df", "attempt_id": "a2bdbc3a62c1", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:27:41.777425Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 1328, "message_tokens": 1232, "message_utf8_bytes": 3205, "cache_tensor_bytes": null, "serialized_payload_bytes": 3205, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28050.821875105612, "ttft_ms": 13.62633309327066, "decode_ms": 13.705875026062131, "receiver_prefill_ms": 142.59266608860344}, "total_wall_ms": 28222.779625095427, "ttft_ms": 13.62633309327066, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0aab8a264fc2c9db61fe90748315b3a43cd278e4e07289df1501836a0af8d584", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9d41472c55f4d13f67218360", "attempt_id": "1c48852d231d", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:10.000009Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2619, "message_tokens": 2529, "message_utf8_bytes": 6537, "cache_tensor_bytes": null, "serialized_payload_bytes": 6537, "side_information_bytes": 0, "fetched_bytes": 3333, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28035.547083010897, "ttft_ms": 13.620582991279662, "decode_ms": 13.604499981738627, "receiver_prefill_ms": 342.5662500085309}, "total_wall_ms": 28408.829165971838, "ttft_ms": 13.620582991279662, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "5e7b46f13339bd6b22b905feb0fc34ca53c7feeb2f861c793eba2676d2981b3c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4494148375f88700fad8f180", "attempt_id": "65b03558fbf0", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:10.388605Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2501, "message_tokens": 2410, "message_utf8_bytes": 6329, "cache_tensor_bytes": null, "serialized_payload_bytes": 6329, "side_information_bytes": 0, "fetched_bytes": 3108, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28035.547083010897, "ttft_ms": 14.111083932220936, "decode_ms": 149.97862500604242, "receiver_prefill_ms": 284.52104108873755}, "total_wall_ms": 28487.955458112992, "ttft_ms": 14.111083932220936, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e484c6dd0347ce0aa4e929392e2633e442f1174fdcbd045668f5b229350af05c", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 1187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9e80234cef9da5653d0d275b", "attempt_id": "85ca8d7e1d68", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:10.891692Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2616, "message_tokens": 2518, "message_utf8_bytes": 6510, "cache_tensor_bytes": null, "serialized_payload_bytes": 6510, "side_information_bytes": 0, "fetched_bytes": 3313, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28035.547083010897, "ttft_ms": 13.492499943822622, "decode_ms": 95.65154102165252, "receiver_prefill_ms": 282.94274990912527}, "total_wall_ms": 28431.034333072603, "ttft_ms": 13.492499943822622, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4655775", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2e60a5bac4e87c6c86dec000831eb5e3b771bc24f556057b501f4555cb2ecf21", "output_hash": "b7861433980fb1fe1626f95887719df5e18c1ad310548d7311301fbb11cb9171"} | ||||
| 1188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1867369265aecee719263326", "attempt_id": "44b05fa1335c", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:11.302200Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2618, "message_tokens": 2529, "message_utf8_bytes": 6537, "cache_tensor_bytes": null, "serialized_payload_bytes": 6537, "side_information_bytes": 0, "fetched_bytes": 3333, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28035.547083010897, "ttft_ms": 13.889124966226518, "decode_ms": 94.91754195187241, "receiver_prefill_ms": 284.47145805694163}, "total_wall_ms": 28432.196208043024, "ttft_ms": 13.889124966226518, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "7186018b6a3350f0f565b2c12083b151ad86c7829bc58576fa99624bf7e5bd85", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | ||||
| 1189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0a0b324d166090ecdabee799", "attempt_id": "8df7a3fe9bf6", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:11.712942Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2602, "message_tokens": 2505, "message_utf8_bytes": 6481, "cache_tensor_bytes": null, "serialized_payload_bytes": 6481, "side_information_bytes": 0, "fetched_bytes": 3262, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28035.547083010897, "ttft_ms": 13.980792020447552, "decode_ms": 68.3760839747265, "receiver_prefill_ms": 317.11629196070135}, "total_wall_ms": 28438.77391703427, "ttft_ms": 13.980792020447552, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3ca3cde20108ad319d8dc922123ea2fb5a2867194bce410b066b3bf7d6a0569b", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 1190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e8aedb0e47272a01b3a4f31e", "attempt_id": "296a2dfc0999", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:12.130782Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2622, "message_tokens": 2529, "message_utf8_bytes": 6537, "cache_tensor_bytes": null, "serialized_payload_bytes": 6537, "side_information_bytes": 0, "fetched_bytes": 3333, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28035.547083010897, "ttft_ms": 13.980207964777946, "decode_ms": 135.17216593027115, "receiver_prefill_ms": 335.47487505711615}, "total_wall_ms": 28523.67470797617, "ttft_ms": 13.980207964777946, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "19,448,440", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a77dad4d7a0729401a516c700a5134a9732c132577c137e12c850e2178335ab4", "output_hash": "cb22a425e0adaca6abcd3a046ec8e2446010ee27157675063eca3d020380d197"} | ||||
| 1191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "39ef6533a1152f20e689e42e", "attempt_id": "84749f5b440c", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:12.633691Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2570, "message_tokens": 2477, "message_utf8_bytes": 6548, "cache_tensor_bytes": null, "serialized_payload_bytes": 6548, "side_information_bytes": 0, "fetched_bytes": 3304, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28035.547083010897, "ttft_ms": 13.710000086575747, "decode_ms": 13.635792070999742, "receiver_prefill_ms": 428.7236660020426}, "total_wall_ms": 28495.703082997352, "ttft_ms": 13.710000086575747, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3b118b05e0fb2e5caeb47aaa15f542169caf0e8a965b70694c277fbdcd6abbb6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "55581f3062022a6ea68a4353", "attempt_id": "c0c1048b566a", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:13.108304Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 2629, "message_tokens": 2534, "message_utf8_bytes": 6548, "cache_tensor_bytes": null, "serialized_payload_bytes": 6548, "side_information_bytes": 0, "fetched_bytes": 3350, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28035.547083010897, "ttft_ms": 13.793749967589974, "decode_ms": 13.334208051674068, "receiver_prefill_ms": 990.1274999137968}, "total_wall_ms": 29056.311708060093, "ttft_ms": 13.793749967589974, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a18eb01493865a50d0e2d8c2a121d303fab4c9ed44a213eae402d3537f1fd5ed", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1f5b819e01bfe706227c2ba3", "attempt_id": "617283aff9e9", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:14.632407Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 92565504}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 8582, "cache_tensor_bytes": 92565504, "serialized_payload_bytes": 92565504, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 487.7696660114452, "ttft_ms": 29.91020807530731, "decode_ms": 134.5039999578148, "receiver_prefill_ms": 0.0}, "total_wall_ms": 657.0747500518337, "ttft_ms": 29.91020807530731, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,505,050", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "ce50815ff9cdaab72b318f821f80a5ad96dc257c6df51048d6fd9c743b4157c6"} | ||||
| 1194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "766f030d67e8377f2286e43d", "attempt_id": "78af82bbbcaf", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:14.818348Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 92565504}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 45, "message_tokens": null, "message_utf8_bytes": 8582, "cache_tensor_bytes": 92565504, "serialized_payload_bytes": 92565504, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 487.7696660114452, "ttft_ms": 27.635624981485307, "decode_ms": 142.99095899332315, "receiver_prefill_ms": 0.0}, "total_wall_ms": 661.1642490606755, "ttft_ms": 27.635624981485307, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MH-96F-2099", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "95c230d14a055d30e0e1d4355caf07808e1c968b1feab9e0607d8bd37b1b43dc"} | ||||
| 1195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "7b6bf03e022c02ac8f4a899d", "attempt_id": "445a22db73f3", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:15.007520Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 92565504}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 52, "message_tokens": null, "message_utf8_bytes": 8582, "cache_tensor_bytes": 92565504, "serialized_payload_bytes": 92565504, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 487.7696660114452, "ttft_ms": 29.698000056669116, "decode_ms": 98.41141698416322, "receiver_prefill_ms": 0.0}, "total_wall_ms": 618.524999008514, "ttft_ms": 29.698000056669116, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8955410", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "5b3f7267844b20dee460b7ecb0817bfd848295a2976bea23185c548209b23c6d"} | ||||
| 1196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b762f207ea2a590928e58774", "attempt_id": "3887c46c3a99", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:15.155750Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 92565504}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 43, "message_tokens": null, "message_utf8_bytes": 8582, "cache_tensor_bytes": 92565504, "serialized_payload_bytes": 92565504, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 487.7696660114452, "ttft_ms": 29.772916925139725, "decode_ms": 127.19450006261468, "receiver_prefill_ms": 0.0}, "total_wall_ms": 647.5418750196695, "ttft_ms": 29.772916925139725, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,663,695", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "8a8c707b1b5795e347ee48f254989477cc20a872192b710ac34c4cf564f0effa"} | ||||
| 1197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "77ff29deca32088b5eec489f", "attempt_id": "d1ed57316219", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:15.330786Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 92565504}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 51, "message_tokens": null, "message_utf8_bytes": 8582, "cache_tensor_bytes": 92565504, "serialized_payload_bytes": 92565504, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 487.7696660114452, "ttft_ms": 29.239209019578993, "decode_ms": 70.78299997374415, "receiver_prefill_ms": 0.0}, "total_wall_ms": 590.0755409384146, "ttft_ms": 29.239209019578993, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 1198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "67449eaa3c6798cb2f566665", "attempt_id": "6b2347951ca1", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:15.448340Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 92565504}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 8582, "cache_tensor_bytes": 92565504, "serialized_payload_bytes": 92565504, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 487.7696660114452, "ttft_ms": 52.044957992620766, "decode_ms": 112.88833396974951, "receiver_prefill_ms": 0.0}, "total_wall_ms": 655.3992490516976, "ttft_ms": 52.044957992620766, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15183105", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "2256f81e655ace749f49dfbb9d2b806fabd740ffda7236551018405cf9547092"} | ||||
| 1199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6211333f512d03f041e3acdd", "attempt_id": "def3864623f7", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:15.630612Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 92565504}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 8582, "cache_tensor_bytes": 92565504, "serialized_payload_bytes": 92565504, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 487.7696660114452, "ttft_ms": 54.43337489850819, "decode_ms": 14.31937504094094, "receiver_prefill_ms": 0.0}, "total_wall_ms": 558.7156240362674, "ttft_ms": 54.43337489850819, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "66b4195ebabd4f87264ad831", "attempt_id": "5d64181577c4", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:15.715627Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 92565504}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 8582, "cache_tensor_bytes": 92565504, "serialized_payload_bytes": 92565504, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 487.7696660114452, "ttft_ms": 26.682708063162863, "decode_ms": 14.19933291617781, "receiver_prefill_ms": 0.0}, "total_wall_ms": 531.5161660546437, "ttft_ms": 26.682708063162863, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Kovar-9", "bogus_amount": "5,251,445", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1201 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e941fcd041296b2622a700d5", "attempt_id": "20e5816e8fe3", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:16.772212Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6274, "message_tokens": 6185, "message_utf8_bytes": 30182, "cache_tensor_bytes": null, "serialized_payload_bytes": 30182, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03845803439617157, "ttft_ms": 13.884666957892478, "decode_ms": 98.2951249461621, "receiver_prefill_ms": 752.3895830381662}, "total_wall_ms": 876.5390410553664, "ttft_ms": 13.884666957892478, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "687,975", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "30ea0ef6bbf3b28d57c376afa4b6b426001dcf7247cb72f5cc1167b02183b28d", "output_hash": "ef19034975881d08c60ac17454ae5ab6c3e5ce2b4b41f46e1509aa90f9a2ee93"} | ||||
| 1202 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b35c1a8a657e227e6104d1ed", "attempt_id": "eb61f7760fac", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:17.666366Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6271, "message_tokens": 6185, "message_utf8_bytes": 30182, "cache_tensor_bytes": null, "serialized_payload_bytes": 30182, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03845803439617157, "ttft_ms": 13.802125002257526, "decode_ms": 139.92024993058294, "receiver_prefill_ms": 733.0049999291077}, "total_wall_ms": 896.4354160707444, "ttft_ms": 13.802125002257526, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PF-86G-3220", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "30ea0ef6bbf3b28d57c376afa4b6b426001dcf7247cb72f5cc1167b02183b28d", "output_hash": "35ef227d6ed3e91b9e3ce606beff647cc9c529f914331f075b2ff73fb82a5fb2"} | ||||
| 1203 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "877f3d2b4882f29da863c891", "attempt_id": "0333ce2e4650", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:18.580390Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6278, "message_tokens": 6185, "message_utf8_bytes": 30182, "cache_tensor_bytes": null, "serialized_payload_bytes": 30182, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03845803439617157, "ttft_ms": 13.902290957048535, "decode_ms": 124.60770807228982, "receiver_prefill_ms": 742.3407499445602}, "total_wall_ms": 890.6800409313291, "ttft_ms": 13.902290957048535, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,041,915", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "30ea0ef6bbf3b28d57c376afa4b6b426001dcf7247cb72f5cc1167b02183b28d", "output_hash": "f92c09b74703850def16f12d425c032d46efc5486dc44dfdda4d19d726710546"} | ||||
| 1204 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d7ba0fd8b70f8a4e357f7bf2", "attempt_id": "8b90cff29087", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:19.488718Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6271, "message_tokens": 6185, "message_utf8_bytes": 30182, "cache_tensor_bytes": null, "serialized_payload_bytes": 30182, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03845803439617157, "ttft_ms": 13.904000050388277, "decode_ms": 97.25762507878244, "receiver_prefill_ms": 736.6374999983236}, "total_wall_ms": 857.4109580367804, "ttft_ms": 13.904000050388277, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "314,635", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "30ea0ef6bbf3b28d57c376afa4b6b426001dcf7247cb72f5cc1167b02183b28d", "output_hash": "2d223f45af3560ed181ef7c63a9aeb2a1220ec6539ef00cd550bfbfb2dcef87b"} | ||||
| 1205 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "866025e9305ad49e92b66fed", "attempt_id": "27ba2bf8af3a", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:20.362843Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6281, "message_tokens": 6185, "message_utf8_bytes": 30182, "cache_tensor_bytes": null, "serialized_payload_bytes": 30182, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03845803439617157, "ttft_ms": 14.08329198602587, "decode_ms": 83.49633391480893, "receiver_prefill_ms": 748.9049999276176}, "total_wall_ms": 857.6037919847295, "ttft_ms": 14.08329198602587, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Rifel-16", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "30ea0ef6bbf3b28d57c376afa4b6b426001dcf7247cb72f5cc1167b02183b28d", "output_hash": "34afeff5cc7f06df0544f826036c046cb8534ac4054132ee05dccf975102a81b"} | ||||
| 1206 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "7339b499d0632370ed5e3b9e", "attempt_id": "4e95fbe9722d", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:21.238261Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6274, "message_tokens": 6185, "message_utf8_bytes": 30182, "cache_tensor_bytes": null, "serialized_payload_bytes": 30182, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03845803439617157, "ttft_ms": 13.89737508725375, "decode_ms": 111.61254195030779, "receiver_prefill_ms": 754.9543749773875}, "total_wall_ms": 890.384583035484, "ttft_ms": 13.89737508725375, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22046.79", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "30ea0ef6bbf3b28d57c376afa4b6b426001dcf7247cb72f5cc1167b02183b28d", "output_hash": "a082dab7fa4264589e3930b23cc11d9c4d27ed51419fd26726bf7433c87d9a0c"} | ||||
| 1207 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "61c746eb76f46fe9dc88cede", "attempt_id": "18bcf076898b", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:22.146178Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6275, "message_tokens": 6185, "message_utf8_bytes": 30182, "cache_tensor_bytes": null, "serialized_payload_bytes": 30182, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03845803439617157, "ttft_ms": 14.18875006493181, "decode_ms": 14.014750020578504, "receiver_prefill_ms": 765.0118339806795}, "total_wall_ms": 802.9102490982041, "ttft_ms": 14.18875006493181, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "30ea0ef6bbf3b28d57c376afa4b6b426001dcf7247cb72f5cc1167b02183b28d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1208 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b3b02d556dc9acc773968c1e", "attempt_id": "e877880565e1", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:22.966486Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6276, "message_tokens": 6185, "message_utf8_bytes": 30182, "cache_tensor_bytes": null, "serialized_payload_bytes": 30182, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03845803439617157, "ttft_ms": 14.081540983170271, "decode_ms": 14.046625001356006, "receiver_prefill_ms": 791.6234170552343}, "total_wall_ms": 829.4645419809967, "ttft_ms": 14.081540983170271, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "30ea0ef6bbf3b28d57c376afa4b6b426001dcf7247cb72f5cc1167b02183b28d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1209 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f3025acd90c679c71ecd4cb7", "attempt_id": "c9342344a1c2", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:38.396330Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1128, "message_tokens": 1037, "message_utf8_bytes": 2529, "cache_tensor_bytes": null, "serialized_payload_bytes": 2529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14583.073709043674, "ttft_ms": 13.54591699782759, "decode_ms": 93.23150001000613, "receiver_prefill_ms": 121.63291696924716}, "total_wall_ms": 14813.404584070668, "ttft_ms": 13.54591699782759, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "687,975", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a4056e87072947fb029db964fab9955eba9ab8947bc294a1b2daecaa5c7490f", "output_hash": "ef19034975881d08c60ac17454ae5ab6c3e5ce2b4b41f46e1509aa90f9a2ee93"} | ||||
| 1210 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0ac754abdd04d7487f268b88", "attempt_id": "c3d3710ca4a4", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:38.644584Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1125, "message_tokens": 1037, "message_utf8_bytes": 2529, "cache_tensor_bytes": null, "serialized_payload_bytes": 2529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14583.073709043674, "ttft_ms": 13.755416963249445, "decode_ms": 134.27087501622736, "receiver_prefill_ms": 120.77479204162955}, "total_wall_ms": 14853.781500947662, "ttft_ms": 13.755416963249445, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PF-86G-3220", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a4056e87072947fb029db964fab9955eba9ab8947bc294a1b2daecaa5c7490f", "output_hash": "35ef227d6ed3e91b9e3ce606beff647cc9c529f914331f075b2ff73fb82a5fb2"} | ||||
| 1211 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "03f1d503403339c62919840a", "attempt_id": "bfd659c8e229", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:38.932307Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1132, "message_tokens": 1037, "message_utf8_bytes": 2529, "cache_tensor_bytes": null, "serialized_payload_bytes": 2529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14583.073709043674, "ttft_ms": 13.84849997702986, "decode_ms": 94.52579205390066, "receiver_prefill_ms": 121.38166697695851}, "total_wall_ms": 14814.717750996351, "ttft_ms": 13.84849997702986, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5774330", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a4056e87072947fb029db964fab9955eba9ab8947bc294a1b2daecaa5c7490f", "output_hash": "fb0fe829e6d55fb6fc250a6f0ea5faafc783e6dde33a8f87c31847eb8e1efd08"} | ||||
| 1212 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2c1ed6b33ed85b50d7e62278", "attempt_id": "04f71b66e1a9", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:39.181708Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1125, "message_tokens": 1037, "message_utf8_bytes": 2529, "cache_tensor_bytes": null, "serialized_payload_bytes": 2529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14583.073709043674, "ttft_ms": 13.48758302628994, "decode_ms": 94.17175000999123, "receiver_prefill_ms": 120.87945791427046}, "total_wall_ms": 14813.408751040697, "ttft_ms": 13.48758302628994, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "292,855", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a4056e87072947fb029db964fab9955eba9ab8947bc294a1b2daecaa5c7490f", "output_hash": "da1f2ed4aa6131f21ac7ec9afb1642c1e8f016fdb87da106a227d776c5349702"} | ||||
| 1213 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d565366f787b73ae86844375", "attempt_id": "a6dd96efa0c7", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:39.428936Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1135, "message_tokens": 1037, "message_utf8_bytes": 2529, "cache_tensor_bytes": null, "serialized_payload_bytes": 2529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14583.073709043674, "ttft_ms": 13.735540909692645, "decode_ms": 93.80545804742724, "receiver_prefill_ms": 121.6124159982428}, "total_wall_ms": 14814.098751056008, "ttft_ms": 13.735540909692645, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talostmel-19", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a4056e87072947fb029db964fab9955eba9ab8947bc294a1b2daecaa5c7490f", "output_hash": "d36ce632b9874676c785373c6928c2f5d2c3ef3b6f327220429c713e0d2e5490"} | ||||
| 1214 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e6999ff21de74a99c6406b22", "attempt_id": "af0dc5da5870", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:39.676994Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1128, "message_tokens": 1037, "message_utf8_bytes": 2529, "cache_tensor_bytes": null, "serialized_payload_bytes": 2529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14583.073709043674, "ttft_ms": 13.482250040397048, "decode_ms": 94.74604192655534, "receiver_prefill_ms": 121.11800001002848}, "total_wall_ms": 14814.246251014993, "ttft_ms": 13.482250040397048, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2304159", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a4056e87072947fb029db964fab9955eba9ab8947bc294a1b2daecaa5c7490f", "output_hash": "1f7bc9d1acc9966c962b11c4701f6a4f0012ad07abc9c24b016f5bcec862b573"} | ||||
| 1215 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "557d10052e03add7c85fe935", "attempt_id": "3124173abebb", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:39.925835Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1129, "message_tokens": 1037, "message_utf8_bytes": 2529, "cache_tensor_bytes": null, "serialized_payload_bytes": 2529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14583.073709043674, "ttft_ms": 13.43970897141844, "decode_ms": 13.570999959483743, "receiver_prefill_ms": 121.40979198738933}, "total_wall_ms": 14733.315542107448, "ttft_ms": 13.43970897141844, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a4056e87072947fb029db964fab9955eba9ab8947bc294a1b2daecaa5c7490f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1216 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "137f72b1d242d8a3349e08f9", "attempt_id": "9971a84e17c2", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:40.093585Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1130, "message_tokens": 1037, "message_utf8_bytes": 2529, "cache_tensor_bytes": null, "serialized_payload_bytes": 2529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14583.073709043674, "ttft_ms": 13.547584065236151, "decode_ms": 13.40558403171599, "receiver_prefill_ms": 121.14108295645565}, "total_wall_ms": 14733.019125065766, "ttft_ms": 13.547584065236151, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a4056e87072947fb029db964fab9955eba9ab8947bc294a1b2daecaa5c7490f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1217 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1d26244f8d5e2cd59d27e832", "attempt_id": "05df670815c8", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:54.936034Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 16}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 744, "message_tokens": 650, "message_utf8_bytes": 1769, "cache_tensor_bytes": null, "serialized_payload_bytes": 1769, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14674.899542005733, "ttft_ms": 13.682582997716963, "decode_ms": 95.3840829897672, "receiver_prefill_ms": 82.14020798914135}, "total_wall_ms": 14867.657250957564, "ttft_ms": 13.682582997716963, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "687,975", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e7f7e10720e2759dc0c7e6cc62c24bf6663f89ed4f1bb9f6d1b6514400ed0bba", "output_hash": "ef19034975881d08c60ac17454ae5ab6c3e5ce2b4b41f46e1509aa90f9a2ee93"} | ||||
| 1218 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "bec11631a188ea2b294709d0", "attempt_id": "5813535f9e5c", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:55.147823Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 16}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 741, "message_tokens": 650, "message_utf8_bytes": 1769, "cache_tensor_bytes": null, "serialized_payload_bytes": 1769, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14674.899542005733, "ttft_ms": 13.414792018011212, "decode_ms": 13.378959032706916, "receiver_prefill_ms": 80.96370904240757}, "total_wall_ms": 14784.114709007554, "ttft_ms": 13.414792018011212, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e7f7e10720e2759dc0c7e6cc62c24bf6663f89ed4f1bb9f6d1b6514400ed0bba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1219 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e52c9ffb99fed920edf84d88", "attempt_id": "23bcc17c9dd4", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:55.275463Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 16}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 748, "message_tokens": 650, "message_utf8_bytes": 1769, "cache_tensor_bytes": null, "serialized_payload_bytes": 1769, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14674.899542005733, "ttft_ms": 13.505792012438178, "decode_ms": 95.94283404294401, "receiver_prefill_ms": 81.4348750282079}, "total_wall_ms": 14867.261082981713, "ttft_ms": 13.505792012438178, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5774330", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e7f7e10720e2759dc0c7e6cc62c24bf6663f89ed4f1bb9f6d1b6514400ed0bba", "output_hash": "fb0fe829e6d55fb6fc250a6f0ea5faafc783e6dde33a8f87c31847eb8e1efd08"} | ||||
| 1220 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "597b2ac704d450035cc973e5", "attempt_id": "97e2f49541ed", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:55.486010Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 16}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 741, "message_tokens": 650, "message_utf8_bytes": 1769, "cache_tensor_bytes": null, "serialized_payload_bytes": 1769, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14674.899542005733, "ttft_ms": 13.337415992282331, "decode_ms": 81.06137497816235, "receiver_prefill_ms": 80.57170896790922}, "total_wall_ms": 14851.268416969106, "ttft_ms": 13.337415992282331, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "292855", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e7f7e10720e2759dc0c7e6cc62c24bf6663f89ed4f1bb9f6d1b6514400ed0bba", "output_hash": "4d2a03221fc71f99807c30668f5eb1a1311643cf5a57c7f7a36cc0c09df5f518"} | ||||
| 1221 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "af3538fd21563fb5183db20c", "attempt_id": "067ea29031da", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:55.680305Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 16}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 751, "message_tokens": 650, "message_utf8_bytes": 1769, "cache_tensor_bytes": null, "serialized_payload_bytes": 1769, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14674.899542005733, "ttft_ms": 13.39183293748647, "decode_ms": 79.84487502835691, "receiver_prefill_ms": 81.98033296503127}, "total_wall_ms": 14851.535375928506, "ttft_ms": 13.39183293748647, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Rifel-16", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e7f7e10720e2759dc0c7e6cc62c24bf6663f89ed4f1bb9f6d1b6514400ed0bba", "output_hash": "34afeff5cc7f06df0544f826036c046cb8534ac4054132ee05dccf975102a81b"} | ||||
| 1222 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "38b23a43c098a28d7bfc2197", "attempt_id": "2c59310edeac", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:55.874471Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 16}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 744, "message_tokens": 650, "message_utf8_bytes": 1769, "cache_tensor_bytes": null, "serialized_payload_bytes": 1769, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14674.899542005733, "ttft_ms": 13.490624958649278, "decode_ms": 93.72395789250731, "receiver_prefill_ms": 80.55712503846735}, "total_wall_ms": 14864.132874994539, "ttft_ms": 13.490624958649278, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1034.92", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e7f7e10720e2759dc0c7e6cc62c24bf6663f89ed4f1bb9f6d1b6514400ed0bba", "output_hash": "f7c59a0fb9a4fc03e78aede9c28a07034c4e923a03abea9d38dbe44b1600b492"} | ||||
| 1223 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e4ddee6421d8eb6ae6163708", "attempt_id": "4ef6ae768b3f", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:56.081088Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 16}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 745, "message_tokens": 650, "message_utf8_bytes": 1769, "cache_tensor_bytes": null, "serialized_payload_bytes": 1769, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14674.899542005733, "ttft_ms": 13.83487496059388, "decode_ms": 13.44624999910593, "receiver_prefill_ms": 80.75179101433605}, "total_wall_ms": 14784.353625029325, "ttft_ms": 13.83487496059388, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e7f7e10720e2759dc0c7e6cc62c24bf6663f89ed4f1bb9f6d1b6514400ed0bba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1224 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "732bff61662bd51632aa762b", "attempt_id": "70bd6363dd0f", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:28:56.208044Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 16}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 746, "message_tokens": 650, "message_utf8_bytes": 1769, "cache_tensor_bytes": null, "serialized_payload_bytes": 1769, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14674.899542005733, "ttft_ms": 13.562833075411618, "decode_ms": 13.21204099804163, "receiver_prefill_ms": 80.84770804271102}, "total_wall_ms": 14783.90645806212, "ttft_ms": 13.562833075411618, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e7f7e10720e2759dc0c7e6cc62c24bf6663f89ed4f1bb9f6d1b6514400ed0bba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1225 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e1f6a4285ace70c13d9ce1b6", "attempt_id": "80a1d601e0aa", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:10.928705Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1085, "message_tokens": 992, "message_utf8_bytes": 2621, "cache_tensor_bytes": null, "serialized_payload_bytes": 2621, "side_information_bytes": 0, "fetched_bytes": 1361, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14594.316959031858, "ttft_ms": 13.55112495366484, "decode_ms": 94.21429201029241, "receiver_prefill_ms": 116.37962504755706}, "total_wall_ms": 14823.182959109545, "ttft_ms": 13.55112495366484, "input_usage": {"lookups": 5}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "687,975", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4b2910d797d15c5cb9074af211265a6aa24eec64996947e073a26d213fb8bcff", "output_hash": "ef19034975881d08c60ac17454ae5ab6c3e5ce2b4b41f46e1509aa90f9a2ee93"} | ||||
| 1226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a73c96153b7068fa21d28ebd", "attempt_id": "722a183aaff8", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:11.175102Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1017, "message_tokens": 927, "message_utf8_bytes": 2528, "cache_tensor_bytes": null, "serialized_payload_bytes": 2528, "side_information_bytes": 0, "fetched_bytes": 1277, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14594.316959031858, "ttft_ms": 13.692917069420218, "decode_ms": 14.550624997355044, "receiver_prefill_ms": 107.08954103756696}, "total_wall_ms": 14731.966709019616, "ttft_ms": 13.692917069420218, "input_usage": {"lookups": 5}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ac43bc6034a7c07360f7b90add6726f2ac75f169e6a18f06659a39cd505d5d91", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "142df14e5824d53e5b485a4c", "attempt_id": "ac31c2088e57", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:11.332315Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1089, "message_tokens": 992, "message_utf8_bytes": 2621, "cache_tensor_bytes": null, "serialized_payload_bytes": 2621, "side_information_bytes": 0, "fetched_bytes": 1361, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14594.316959031858, "ttft_ms": 13.411625055596232, "decode_ms": 13.53312493301928, "receiver_prefill_ms": 115.49337499309331}, "total_wall_ms": 14738.90233412385, "ttft_ms": 13.411625055596232, "input_usage": {"lookups": 5}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "8ac47f0cbefb82ca4ecd48085bcdfabfb6a42726b0319de6deaccd7675564603", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5ffaf0650a298f04e1ac434c", "attempt_id": "4759e4bc20c5", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:11.493964Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1082, "message_tokens": 992, "message_utf8_bytes": 2621, "cache_tensor_bytes": null, "serialized_payload_bytes": 2621, "side_information_bytes": 0, "fetched_bytes": 1361, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14594.316959031858, "ttft_ms": 13.45858396962285, "decode_ms": 80.31445904634893, "receiver_prefill_ms": 115.61437498312443}, "total_wall_ms": 14805.583918001503, "ttft_ms": 13.45858396962285, "input_usage": {"lookups": 5}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "753970", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f63c7f5e9930bf7b4c2078a62a6d6e1c4fd9734d0c3e8d803ccb9efb80334dea", "output_hash": "ca9cbd16413b57561a8c177569d5245fb484b5a1ff07417932a75eab78f60c95"} | ||||
| 1229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "052ebf0e2fcedcda1508ce2a", "attempt_id": "6d4a595b6f4e", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:11.723310Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1046, "message_tokens": 946, "message_utf8_bytes": 2543, "cache_tensor_bytes": null, "serialized_payload_bytes": 2543, "side_information_bytes": 0, "fetched_bytes": 1289, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14594.316959031858, "ttft_ms": 13.581290957517922, "decode_ms": 13.909499975852668, "receiver_prefill_ms": 114.03841699939221}, "total_wall_ms": 14737.622876069508, "ttft_ms": 13.581290957517922, "input_usage": {"lookups": 5}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "bc8bcf59cafd5c4f8caf42d0ae0086935dc13646780d50cbd092460af580850c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9ec8b51757e36333c3c87d72", "attempt_id": "e8e82a0643e0", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:11.884413Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1085, "message_tokens": 992, "message_utf8_bytes": 2621, "cache_tensor_bytes": null, "serialized_payload_bytes": 2621, "side_information_bytes": 0, "fetched_bytes": 1361, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14594.316959031858, "ttft_ms": 13.44174996484071, "decode_ms": 95.00545798800886, "receiver_prefill_ms": 115.81654194742441}, "total_wall_ms": 14820.378041942604, "ttft_ms": 13.44174996484071, "input_usage": {"lookups": 5}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1441945", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "8ac47f0cbefb82ca4ecd48085bcdfabfb6a42726b0319de6deaccd7675564603", "output_hash": "ae63a4c42debd069f12befbd7586c0ce040e98a9efd95c9e1d0cb8a3c3a1114b"} | ||||
| 1231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0e5d24d627587f7922746906", "attempt_id": "d7288e26cdc6", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:12.127479Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1063, "message_tokens": 969, "message_utf8_bytes": 2613, "cache_tensor_bytes": null, "serialized_payload_bytes": 2613, "side_information_bytes": 0, "fetched_bytes": 1347, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14594.316959031858, "ttft_ms": 13.778125052340329, "decode_ms": 13.496334082446992, "receiver_prefill_ms": 115.65183300990611}, "total_wall_ms": 14739.11829199642, "ttft_ms": 13.778125052340329, "input_usage": {"lookups": 5}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "8086d90b17e79389f6c3aee84365cf30beafd27e7917c9966b0e61ae60ea8487", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d4ccfa6f3fd836e84148e194", "attempt_id": "5c9038959e87", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:12.289723Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1087, "message_tokens": 992, "message_utf8_bytes": 2621, "cache_tensor_bytes": null, "serialized_payload_bytes": 2621, "side_information_bytes": 0, "fetched_bytes": 1361, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14594.316959031858, "ttft_ms": 13.695167028345168, "decode_ms": 13.589290902018547, "receiver_prefill_ms": 115.83525000605732}, "total_wall_ms": 14739.213249995373, "ttft_ms": 13.695167028345168, "input_usage": {"lookups": 5}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4b2910d797d15c5cb9074af211265a6aa24eec64996947e073a26d213fb8bcff", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e5ea7ab2924114b6c035eb1c", "attempt_id": "ecce7c897099", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:13.228388Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230879232}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30156, "cache_tensor_bytes": 230879232, "serialized_payload_bytes": 230879232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 776.5466249547899, "ttft_ms": 52.97391698695719, "decode_ms": 136.65237498935312, "receiver_prefill_ms": 0.0}, "total_wall_ms": 975.640874938108, "ttft_ms": 52.97391698695719, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,120,879", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c013fa074e4007a6fc0636d19a80febc8aee860429794ef4bbbe381185afe02c"} | ||||
| 1234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f260f97179d0453e81858633", "attempt_id": "484ed88fc951", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:13.445437Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230879232}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 30156, "cache_tensor_bytes": 230879232, "serialized_payload_bytes": 230879232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 776.5466249547899, "ttft_ms": 47.65170800965279, "decode_ms": 150.37654095795006, "receiver_prefill_ms": 0.0}, "total_wall_ms": 981.886291061528, "ttft_ms": 47.65170800965279, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PF-86G-3220", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "35ef227d6ed3e91b9e3ce606beff647cc9c529f914331f075b2ff73fb82a5fb2"} | ||||
| 1235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3a9aa45d26bd4001bf84ee87", "attempt_id": "4b97bacd614f", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:13.668323Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230879232}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 51, "message_tokens": null, "message_utf8_bytes": 30156, "cache_tensor_bytes": 230879232, "serialized_payload_bytes": 230879232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 776.5466249547899, "ttft_ms": 47.77066700626165, "decode_ms": 136.16691704373807, "receiver_prefill_ms": 0.0}, "total_wall_ms": 967.804417014122, "ttft_ms": 47.77066700626165, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,041,915", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "f92c09b74703850def16f12d425c032d46efc5486dc44dfdda4d19d726710546"} | ||||
| 1236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3a4178682d4c0591a78135a3", "attempt_id": "d84f94d8877c", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:13.877549Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230879232}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 30156, "cache_tensor_bytes": 230879232, "serialized_payload_bytes": 230879232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 776.5466249547899, "ttft_ms": 47.336916089989245, "decode_ms": 104.64612499345094, "receiver_prefill_ms": 0.0}, "total_wall_ms": 936.2797919893637, "ttft_ms": 47.336916089989245, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "314,635", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "2d223f45af3560ed181ef7c63a9aeb2a1220ec6539ef00cd550bfbfb2dcef87b"} | ||||
| 1237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b36db80b80269f06fbef1381", "attempt_id": "4423e407d43e", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:14.054840Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230879232}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 54, "message_tokens": null, "message_utf8_bytes": 30156, "cache_tensor_bytes": 230879232, "serialized_payload_bytes": 230879232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 776.5466249547899, "ttft_ms": 49.50524994637817, "decode_ms": 104.88683392759413, "receiver_prefill_ms": 0.0}, "total_wall_ms": 938.16637492273, "ttft_ms": 49.50524994637817, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talostmel-19", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "d36ce632b9874676c785373c6928c2f5d2c3ef3b6f327220429c713e0d2e5490"} | ||||
| 1238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "70d7a290e30c60ddef3d186d", "attempt_id": "1874f852a560", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:14.233935Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230879232}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30156, "cache_tensor_bytes": 230879232, "serialized_payload_bytes": 230879232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 776.5466249547899, "ttft_ms": 48.8192499615252, "decode_ms": 151.69762494042516, "receiver_prefill_ms": 0.0}, "total_wall_ms": 984.5911659067497, "ttft_ms": 48.8192499615252, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20,821,812", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "78d202eed9ae00b429c5ee7f46f81cdc300290373c73658102933f966c5749e1"} | ||||
| 1239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "55adf1e07ce6f4afeb6c61ad", "attempt_id": "8d151e63d909", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:14.459865Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230879232}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 48, "message_tokens": null, "message_utf8_bytes": 30156, "cache_tensor_bytes": 230879232, "serialized_payload_bytes": 230879232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 776.5466249547899, "ttft_ms": 48.52995800320059, "decode_ms": 15.013708034530282, "receiver_prefill_ms": 0.0}, "total_wall_ms": 846.7708749230951, "ttft_ms": 48.52995800320059, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "385f8698e24e690c44f8cbca", "attempt_id": "e9acaaee3e7b", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:14.548215Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230879232}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 30156, "cache_tensor_bytes": 230879232, "serialized_payload_bytes": 230879232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 776.5466249547899, "ttft_ms": 46.36929195839912, "decode_ms": 15.050416928716004, "receiver_prefill_ms": 0.0}, "total_wall_ms": 844.9183749035001, "ttft_ms": 46.36929195839912, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3ae35f103b5336061e03cc58", "attempt_id": "efbdc0dd7c3a", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:14.634302Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6388, "message_tokens": 6299, "message_utf8_bytes": 30686, "cache_tensor_bytes": null, "serialized_payload_bytes": 30686, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.029125018045306206, "ttft_ms": 13.961541000753641, "decode_ms": 96.22474992647767, "receiver_prefill_ms": 746.5892090694979}, "total_wall_ms": 871.6175830923021, "ttft_ms": 13.961541000753641, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "687,975", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a1629a65c5832d2a8c8d06c90d27e3d0c8d3c660c82ac7da12130c875c91992d", "output_hash": "ef19034975881d08c60ac17454ae5ab6c3e5ce2b4b41f46e1509aa90f9a2ee93"} | ||||
| 1242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "85a6ccd3ceec54b51d06ffd6", "attempt_id": "f0d586372060", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:15.522982Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6385, "message_tokens": 6299, "message_utf8_bytes": 30686, "cache_tensor_bytes": null, "serialized_payload_bytes": 30686, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.029125018045306206, "ttft_ms": 14.104458969086409, "decode_ms": 138.4010420879349, "receiver_prefill_ms": 761.9426250457764}, "total_wall_ms": 924.1573330946267, "ttft_ms": 14.104458969086409, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PF-86G-3220", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a1629a65c5832d2a8c8d06c90d27e3d0c8d3c660c82ac7da12130c875c91992d", "output_hash": "35ef227d6ed3e91b9e3ce606beff647cc9c529f914331f075b2ff73fb82a5fb2"} | ||||
| 1243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "fc9924e70a5ab115421163f4", "attempt_id": "185fc794b0dc", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:16.464122Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6392, "message_tokens": 6299, "message_utf8_bytes": 30686, "cache_tensor_bytes": null, "serialized_payload_bytes": 30686, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.029125018045306206, "ttft_ms": 14.11649992223829, "decode_ms": 96.91716695670038, "receiver_prefill_ms": 795.9863749565557}, "total_wall_ms": 916.7706670705229, "ttft_ms": 14.11649992223829, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5774330", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a1629a65c5832d2a8c8d06c90d27e3d0c8d3c660c82ac7da12130c875c91992d", "output_hash": "fb0fe829e6d55fb6fc250a6f0ea5faafc783e6dde33a8f87c31847eb8e1efd08"} | ||||
| 1244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "cbb2237f23ca5a9d2d2fb934", "attempt_id": "ce6abd44bb1d", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:17.400572Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6385, "message_tokens": 6299, "message_utf8_bytes": 30686, "cache_tensor_bytes": null, "serialized_payload_bytes": 30686, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.029125018045306206, "ttft_ms": 14.008625061251223, "decode_ms": 97.54433296620846, "receiver_prefill_ms": 777.63866703026}, "total_wall_ms": 898.926957976073, "ttft_ms": 14.008625061251223, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "314,635", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a1629a65c5832d2a8c8d06c90d27e3d0c8d3c660c82ac7da12130c875c91992d", "output_hash": "2d223f45af3560ed181ef7c63a9aeb2a1220ec6539ef00cd550bfbfb2dcef87b"} | ||||
| 1245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f56cb21ebd6eb507803093e7", "attempt_id": "9bdeb9dab3f4", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:18.317017Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6395, "message_tokens": 6299, "message_utf8_bytes": 30686, "cache_tensor_bytes": null, "serialized_payload_bytes": 30686, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.029125018045306206, "ttft_ms": 13.992166961543262, "decode_ms": 86.47658408153802, "receiver_prefill_ms": 793.4588340576738}, "total_wall_ms": 903.6159589886665, "ttft_ms": 13.992166961543262, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Rifel-16", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a1629a65c5832d2a8c8d06c90d27e3d0c8d3c660c82ac7da12130c875c91992d", "output_hash": "34afeff5cc7f06df0544f826036c046cb8534ac4054132ee05dccf975102a81b"} | ||||
| 1246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3a36a9282714560395ae9804", "attempt_id": "11f6ece7d9c8", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:19.237824Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6388, "message_tokens": 6299, "message_utf8_bytes": 30686, "cache_tensor_bytes": null, "serialized_payload_bytes": 30686, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.029125018045306206, "ttft_ms": 14.196209027431905, "decode_ms": 97.25879202596843, "receiver_prefill_ms": 805.4529159562662}, "total_wall_ms": 926.6065420815721, "ttft_ms": 14.196209027431905, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3228899", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a1629a65c5832d2a8c8d06c90d27e3d0c8d3c660c82ac7da12130c875c91992d", "output_hash": "cfd0ed46facc7c79fb18dcb4d8d599dd6b3f146f49a8d86abe459544ef3b9cdb"} | ||||
| 1247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "493f9872a9fd0e622f1824e9", "attempt_id": "7f4a1a5a5a7a", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:20.181571Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6389, "message_tokens": 6299, "message_utf8_bytes": 30686, "cache_tensor_bytes": null, "serialized_payload_bytes": 30686, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.029125018045306206, "ttft_ms": 14.219791977666318, "decode_ms": 13.836249941959977, "receiver_prefill_ms": 804.2557090520859}, "total_wall_ms": 841.9538750313222, "ttft_ms": 14.219791977666318, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a1629a65c5832d2a8c8d06c90d27e3d0c8d3c660c82ac7da12130c875c91992d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "67790b175a013bd5919fd1cd", "attempt_id": "d030a0349ca8", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:21.040347Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 6390, "message_tokens": 6299, "message_utf8_bytes": 30686, "cache_tensor_bytes": null, "serialized_payload_bytes": 30686, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.029125018045306206, "ttft_ms": 14.124833047389984, "decode_ms": 13.952166074886918, "receiver_prefill_ms": 819.719250081107}, "total_wall_ms": 857.5393341016024, "ttft_ms": 14.124833047389984, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a1629a65c5832d2a8c8d06c90d27e3d0c8d3c660c82ac7da12130c875c91992d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "cb4c086f4314e214a9005b9e", "attempt_id": "6e851f63a52f", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:47.291850Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1827}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1942, "message_tokens": 1852, "message_utf8_bytes": 6509, "cache_tensor_bytes": null, "serialized_payload_bytes": 6509, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 25376.599375042133, "ttft_ms": 13.657125062309206, "decode_ms": 94.81058397796005, "receiver_prefill_ms": 204.9281670479104}, "total_wall_ms": 25694.177916971967, "ttft_ms": 13.657125062309206, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "687,975", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "fce2d59b037adafbbe980681b5eb1030f888f8ba5b729d9f591bb94c1bfeb0d2", "output_hash": "ef19034975881d08c60ac17454ae5ab6c3e5ce2b4b41f46e1509aa90f9a2ee93"} | ||||
| 1250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "565726825dc80735de3ee34b", "attempt_id": "b443e5785223", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:47.627550Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1827}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1939, "message_tokens": 1852, "message_utf8_bytes": 6509, "cache_tensor_bytes": null, "serialized_payload_bytes": 6509, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 25376.599375042133, "ttft_ms": 13.4482909925282, "decode_ms": 134.8007080378011, "receiver_prefill_ms": 204.18279198929667}, "total_wall_ms": 25732.01112507377, "ttft_ms": 13.4482909925282, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PF-86G-3220", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "fce2d59b037adafbbe980681b5eb1030f888f8ba5b729d9f591bb94c1bfeb0d2", "output_hash": "35ef227d6ed3e91b9e3ce606beff647cc9c529f914331f075b2ff73fb82a5fb2"} | ||||
| 1251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1f359e3d7c870dbb8f3c1c5e", "attempt_id": "dfd07ddc7ae8", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:48.000770Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1827}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1946, "message_tokens": 1852, "message_utf8_bytes": 6509, "cache_tensor_bytes": null, "serialized_payload_bytes": 6509, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 25376.599375042133, "ttft_ms": 13.440750073641539, "decode_ms": 94.66208308003843, "receiver_prefill_ms": 205.138957942836}, "total_wall_ms": 25692.98383302521, "ttft_ms": 13.440750073641539, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6041915", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "fce2d59b037adafbbe980681b5eb1030f888f8ba5b729d9f591bb94c1bfeb0d2", "output_hash": "5f8f3414199be3bad75f36df45e3759125ec38c5a7eccea16448f93268c5fa92"} | ||||
| 1252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9949f335e7818f4b95c285b3", "attempt_id": "8760cea08ee4", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:48.334052Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1827}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1939, "message_tokens": 1852, "message_utf8_bytes": 6509, "cache_tensor_bytes": null, "serialized_payload_bytes": 6509, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 25376.599375042133, "ttft_ms": 13.66650010459125, "decode_ms": 94.48895894456655, "receiver_prefill_ms": 203.71045800857246}, "total_wall_ms": 25691.459250054322, "ttft_ms": 13.66650010459125, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "314,635", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "fce2d59b037adafbbe980681b5eb1030f888f8ba5b729d9f591bb94c1bfeb0d2", "output_hash": "2d223f45af3560ed181ef7c63a9aeb2a1220ec6539ef00cd550bfbfb2dcef87b"} | ||||
| 1253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0e89cb7990f74680918b53d3", "attempt_id": "ee8b7e90c347", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:48.666845Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1827}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1949, "message_tokens": 1852, "message_utf8_bytes": 6509, "cache_tensor_bytes": null, "serialized_payload_bytes": 6509, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 25376.599375042133, "ttft_ms": 13.55487504042685, "decode_ms": 94.94716697372496, "receiver_prefill_ms": 206.4797499915585}, "total_wall_ms": 25694.618417066522, "ttft_ms": 13.55487504042685, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talostmel-19", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "fce2d59b037adafbbe980681b5eb1030f888f8ba5b729d9f591bb94c1bfeb0d2", "output_hash": "d36ce632b9874676c785373c6928c2f5d2c3ef3b6f327220429c713e0d2e5490"} | ||||
| 1254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a6514d826baf5b138f85e2bc", "attempt_id": "3c5fec696c01", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:49.002278Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1827}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1942, "message_tokens": 1852, "message_utf8_bytes": 6509, "cache_tensor_bytes": null, "serialized_payload_bytes": 6509, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 25376.599375042133, "ttft_ms": 13.879333040677011, "decode_ms": 136.29879092331976, "receiver_prefill_ms": 213.41824997216463}, "total_wall_ms": 25743.202042067423, "ttft_ms": 13.879333040677011, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22,077,139", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "fce2d59b037adafbbe980681b5eb1030f888f8ba5b729d9f591bb94c1bfeb0d2", "output_hash": "f9ed93d4a2e1fdf1782bdde030148563c3c5321ce15a2e420860c8ab8a868183"} | ||||
| 1255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "877f84bdc134299a0579cb7b", "attempt_id": "ad7efdb40c11", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:49.386284Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1827}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1943, "message_tokens": 1852, "message_utf8_bytes": 6509, "cache_tensor_bytes": null, "serialized_payload_bytes": 6509, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 25376.599375042133, "ttft_ms": 13.712832937017083, "decode_ms": 13.8938749441877, "receiver_prefill_ms": 211.3716669846326}, "total_wall_ms": 25618.57658298686, "ttft_ms": 13.712832937017083, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "fce2d59b037adafbbe980681b5eb1030f888f8ba5b729d9f591bb94c1bfeb0d2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2e613d30993b2166efc4ec84", "attempt_id": "6fbfa74651ad", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:29:49.645822Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1827}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1944, "message_tokens": 1852, "message_utf8_bytes": 6509, "cache_tensor_bytes": null, "serialized_payload_bytes": 6509, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 25376.599375042133, "ttft_ms": 13.752958038821816, "decode_ms": 13.984875055029988, "receiver_prefill_ms": 223.85970794130117}, "total_wall_ms": 25631.163166020997, "ttft_ms": 13.752958038821816, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "fce2d59b037adafbbe980681b5eb1030f888f8ba5b729d9f591bb94c1bfeb0d2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "50a4445f39f9db1c3fbea8c1", "attempt_id": "e97125b7c71d", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:16.057227Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 27}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1179, "message_tokens": 1085, "message_utf8_bytes": 2921, "cache_tensor_bytes": null, "serialized_payload_bytes": 2921, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26139.297457993962, "ttft_ms": 13.463124982081354, "decode_ms": 93.7956249108538, "receiver_prefill_ms": 125.10354199912399}, "total_wall_ms": 26378.505249973387, "ttft_ms": 13.463124982081354, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "326,975", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6af415f67866ccc4a833b68596dca13df4f4e8c7106c77693cbe69832bfb6d35", "output_hash": "f578533e5179bf25f29e177b2f8eec198dca384c7f5584e473eb11f7427728bf"} | ||||
| 1258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "09a0b22c9b201f586789a6e9", "attempt_id": "c069d1e2169e", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:16.314814Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 27}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1176, "message_tokens": 1085, "message_utf8_bytes": 2921, "cache_tensor_bytes": null, "serialized_payload_bytes": 2921, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26139.297457993962, "ttft_ms": 14.675707905553281, "decode_ms": 14.280749950557947, "receiver_prefill_ms": 379.5532500371337}, "total_wall_ms": 26549.725457909517, "ttft_ms": 14.675707905553281, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6af415f67866ccc4a833b68596dca13df4f4e8c7106c77693cbe69832bfb6d35", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "aa4b3ccfee1edc84f6ea7acf", "attempt_id": "f2e46f808e74", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:16.744500Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 27}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1183, "message_tokens": 1085, "message_utf8_bytes": 2921, "cache_tensor_bytes": null, "serialized_payload_bytes": 2921, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26139.297457993962, "ttft_ms": 89.05462501570582, "decode_ms": 14.41008411347866, "receiver_prefill_ms": 1895.2112080296502}, "total_wall_ms": 28140.168583020568, "ttft_ms": 89.05462501570582, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6af415f67866ccc4a833b68596dca13df4f4e8c7106c77693cbe69832bfb6d35", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5abe3eed0dc5e529497e5488", "attempt_id": "4edd8c3131de", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:18.765642Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 27}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1176, "message_tokens": 1085, "message_utf8_bytes": 2921, "cache_tensor_bytes": null, "serialized_payload_bytes": 2921, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26139.297457993962, "ttft_ms": 14.081125031225383, "decode_ms": 97.65345801133662, "receiver_prefill_ms": 144.03470803517848}, "total_wall_ms": 26397.122082998976, "ttft_ms": 14.081125031225383, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "326,975", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6af415f67866ccc4a833b68596dca13df4f4e8c7106c77693cbe69832bfb6d35", "output_hash": "f578533e5179bf25f29e177b2f8eec198dca384c7f5584e473eb11f7427728bf"} | ||||
| 1261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f3a4b5f1f12ea42f3758f1a1", "attempt_id": "796d5eafc483", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:19.047883Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 27}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1186, "message_tokens": 1085, "message_utf8_bytes": 2921, "cache_tensor_bytes": null, "serialized_payload_bytes": 2921, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26139.297457993962, "ttft_ms": 14.015124994330108, "decode_ms": 94.56670901272446, "receiver_prefill_ms": 146.98204200249165}, "total_wall_ms": 26396.862208028324, "ttft_ms": 14.015124994330108, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talostmel-19", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6af415f67866ccc4a833b68596dca13df4f4e8c7106c77693cbe69832bfb6d35", "output_hash": "d36ce632b9874676c785373c6928c2f5d2c3ef3b6f327220429c713e0d2e5490"} | ||||
| 1262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "121dd36fb62e63768ce7b072", "attempt_id": "f29ff618c8a9", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:19.324079Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 27}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1179, "message_tokens": 1085, "message_utf8_bytes": 2921, "cache_tensor_bytes": null, "serialized_payload_bytes": 2921, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26139.297457993962, "ttft_ms": 13.477791915647686, "decode_ms": 94.51912506483495, "receiver_prefill_ms": 154.128959053196}, "total_wall_ms": 26403.27995806001, "ttft_ms": 13.477791915647686, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1389750", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6af415f67866ccc4a833b68596dca13df4f4e8c7106c77693cbe69832bfb6d35", "output_hash": "e0aabc7ef11c09c192fa67d678c29e2d671d7ded07b68555a8f7ee882c681adf"} | ||||
| 1263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2820d3d7c8dff1b3a0afff8a", "attempt_id": "036506adc868", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:19.605643Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 27}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1180, "message_tokens": 1085, "message_utf8_bytes": 2921, "cache_tensor_bytes": null, "serialized_payload_bytes": 2921, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26139.297457993962, "ttft_ms": 13.403709046542645, "decode_ms": 134.20887489337474, "receiver_prefill_ms": 124.29491698276252}, "total_wall_ms": 26413.080791011453, "ttft_ms": 13.403709046542645, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZH-49V-5200", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6af415f67866ccc4a833b68596dca13df4f4e8c7106c77693cbe69832bfb6d35", "output_hash": "86e838b69725cb37b0278f6792e5169986b076b907a6e4269e72578c9f3d2a0a"} | ||||
| 1264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4de8085d3d1e7fbdf5a8a6e0", "attempt_id": "e5fb021f0268", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:19.896851Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 27}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 1181, "message_tokens": 1085, "message_utf8_bytes": 2921, "cache_tensor_bytes": null, "serialized_payload_bytes": 2921, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26139.297457993962, "ttft_ms": 13.628540909849107, "decode_ms": 13.364666025154293, "receiver_prefill_ms": 124.47062495630234}, "total_wall_ms": 26292.649833019823, "ttft_ms": 13.628540909849107, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6af415f67866ccc4a833b68596dca13df4f4e8c7106c77693cbe69832bfb6d35", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "de4f59eff4ccafb2d4dad690", "attempt_id": "a1fa09571d67", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:46.456364Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 2594, "message_tokens": 2501, "message_utf8_bytes": 6628, "cache_tensor_bytes": null, "serialized_payload_bytes": 6628, "side_information_bytes": 0, "fetched_bytes": 3416, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26388.96712497808, "ttft_ms": 13.599249999970198, "decode_ms": 94.49212509207428, "receiver_prefill_ms": 307.1271670050919}, "total_wall_ms": 26807.720249984413, "ttft_ms": 13.599249999970198, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "687,975", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "d4bb17e378679eb3945a0771dfcc20f8f33d0e49709ec7a673e887bbb8ae5e1f", "output_hash": "ef19034975881d08c60ac17454ae5ab6c3e5ce2b4b41f46e1509aa90f9a2ee93"} | ||||
| 1266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c166988a6e15b5c51685e724", "attempt_id": "5fd698a0dced", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:46.899238Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 2546, "message_tokens": 2456, "message_utf8_bytes": 6561, "cache_tensor_bytes": null, "serialized_payload_bytes": 6561, "side_information_bytes": 0, "fetched_bytes": 3336, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26388.96712497808, "ttft_ms": 14.812375069595873, "decode_ms": 14.036459033377469, "receiver_prefill_ms": 350.62629100866616}, "total_wall_ms": 26772.52762496937, "ttft_ms": 14.812375069595873, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ba07ed4b8b14eb1ce0f9a81b46254e6a4e14be640581ee5194e1ea0263fb4456", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "651683015a43cdffe283d8fa", "attempt_id": "146c2c042470", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:47.299854Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 2621, "message_tokens": 2524, "message_utf8_bytes": 6663, "cache_tensor_bytes": null, "serialized_payload_bytes": 6663, "side_information_bytes": 0, "fetched_bytes": 3420, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26388.96712497808, "ttft_ms": 13.781875022687018, "decode_ms": 13.484333991073072, "receiver_prefill_ms": 530.2059589885175}, "total_wall_ms": 26950.507750036195, "ttft_ms": 13.781875022687018, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "1ddc927267ee9d5539c10042f8829843c53f6c888ab73f7ef106acc0f93f3242", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "18517989dcb4fe4e1bbb18ed", "attempt_id": "bab0f4b6ba9c", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:47.879647Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 2614, "message_tokens": 2524, "message_utf8_bytes": 6663, "cache_tensor_bytes": null, "serialized_payload_bytes": 6663, "side_information_bytes": 0, "fetched_bytes": 3420, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26388.96712497808, "ttft_ms": 13.971916981972754, "decode_ms": 82.0794579340145, "receiver_prefill_ms": 298.2644169824198}, "total_wall_ms": 26786.69970901683, "ttft_ms": 13.971916981972754, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "292855", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "1ddc927267ee9d5539c10042f8829843c53f6c888ab73f7ef106acc0f93f3242", "output_hash": "4d2a03221fc71f99807c30668f5eb1a1311643cf5a57c7f7a36cc0c09df5f518"} | ||||
| 1269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "accccdf6b0f71476496c1ca0", "attempt_id": "89ad7c4edd60", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:48.294574Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 2603, "message_tokens": 2503, "message_utf8_bytes": 6605, "cache_tensor_bytes": null, "serialized_payload_bytes": 6605, "side_information_bytes": 0, "fetched_bytes": 3384, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26388.96712497808, "ttft_ms": 13.615000061690807, "decode_ms": 95.5932920332998, "receiver_prefill_ms": 287.9390419693664}, "total_wall_ms": 26789.543834049255, "ttft_ms": 13.615000061690807, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talostmel-19", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "d721b0a442872f86f11822da780e30a5b0e1bbfe116d4483abc7173a5ea6eb4e", "output_hash": "d36ce632b9874676c785373c6928c2f5d2c3ef3b6f327220429c713e0d2e5490"} | ||||
| 1270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "dfa40c3df14984f6dfbfc759", "attempt_id": "965879ae0efd", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:48.712928Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 2615, "message_tokens": 2522, "message_utf8_bytes": 6694, "cache_tensor_bytes": null, "serialized_payload_bytes": 6694, "side_information_bytes": 0, "fetched_bytes": 3448, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26388.96712497808, "ttft_ms": 13.640958000905812, "decode_ms": 96.40233300160617, "receiver_prefill_ms": 300.0372499227524}, "total_wall_ms": 26802.61833302211, "ttft_ms": 13.640958000905812, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2341350", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "15357f6c66639551691b74dea44989baa403c45954ec0d1ca978c56217ae5fe0", "output_hash": "4cbdc8d4bde64906434162984967a1eb27b9a045e9b2dca8ccadca9836a480d7"} | ||||
| 1271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e5d1390ed9688ba0b2d58690", "attempt_id": "d86138fadd52", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:49.145104Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 2592, "message_tokens": 2498, "message_utf8_bytes": 6651, "cache_tensor_bytes": null, "serialized_payload_bytes": 6651, "side_information_bytes": 0, "fetched_bytes": 3397, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26388.96712497808, "ttft_ms": 13.876750017516315, "decode_ms": 13.817957951687276, "receiver_prefill_ms": 323.28825001604855}, "total_wall_ms": 26744.25191595219, "ttft_ms": 13.876750017516315, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3ef6b0489e9defd32b1f903826e5558af18f694967e5e652335b5314840a6df2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c89dff034f85c859e3889c6c", "attempt_id": "6b58720ae64f", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:49.528627Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 2619, "message_tokens": 2524, "message_utf8_bytes": 6663, "cache_tensor_bytes": null, "serialized_payload_bytes": 6663, "side_information_bytes": 0, "fetched_bytes": 3420, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26388.96712497808, "ttft_ms": 13.88912508264184, "decode_ms": 13.854042044840753, "receiver_prefill_ms": 311.8051670026034}, "total_wall_ms": 26732.018083916046, "ttft_ms": 13.88912508264184, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e59312c5b542ffcccd40c34da8936eca082244b7db4dba9e53c1d641518bb845", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e1af61428d53ed6739322568", "attempt_id": "3a2dc4df3920", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:50.936919Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237957120}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30632, "cache_tensor_bytes": 237957120, "serialized_payload_bytes": 237957120, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1047.6557079236954, "ttft_ms": 52.27395903784782, "decode_ms": 140.6419170089066, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1247.2787499427795, "ttft_ms": 52.27395903784782, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,120,879", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c013fa074e4007a6fc0636d19a80febc8aee860429794ef4bbbe381185afe02c"} | ||||
| 1274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "570f36de1c7c0164ddaf9ffc", "attempt_id": "e2261e3cee0a", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:51.153962Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237957120}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 30632, "cache_tensor_bytes": 237957120, "serialized_payload_bytes": 237957120, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1047.6557079236954, "ttft_ms": 48.579333000816405, "decode_ms": 150.86141601204872, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1251.6609999584034, "ttft_ms": 48.579333000816405, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GX-54Q-4853", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "8a4b595bf859d0e547dcbb91a1485552981f1f40252e9575acc6751bff785bea"} | ||||
| 1275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "437abf6b717eb2155c7752c5", "attempt_id": "eb3fafbc5465", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:51.376084Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237957120}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 51, "message_tokens": null, "message_utf8_bytes": 30632, "cache_tensor_bytes": 237957120, "serialized_payload_bytes": 237957120, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1047.6557079236954, "ttft_ms": 91.02883306331933, "decode_ms": 105.66420806571841, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1248.8432909594849, "ttft_ms": 91.02883306331933, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6041915", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "5f8f3414199be3bad75f36df45e3759125ec38c5a7eccea16448f93268c5fa92"} | ||||
| 1276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "740e45986dd4a2b1bb4c750e", "attempt_id": "d1833e62899d", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:51.595146Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237957120}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 30632, "cache_tensor_bytes": 237957120, "serialized_payload_bytes": 237957120, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1047.6557079236954, "ttft_ms": 50.18000002019107, "decode_ms": 15.201958012767136, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1117.8218749118969, "ttft_ms": 50.18000002019107, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b9f4c8cae0c2363bd2a42da2", "attempt_id": "0f3117e304f4", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:51.683155Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237957120}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 54, "message_tokens": null, "message_utf8_bytes": 30632, "cache_tensor_bytes": 237957120, "serialized_payload_bytes": 237957120, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1047.6557079236954, "ttft_ms": 97.44029096327722, "decode_ms": 91.51095896959305, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1241.2401239853352, "ttft_ms": 97.44029096327722, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Rifel-16", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "34afeff5cc7f06df0544f826036c046cb8534ac4054132ee05dccf975102a81b"} | ||||
| 1278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9d3c8b4c8cddfa77c10308f1", "attempt_id": "52fb359c418e", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:51.894516Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237957120}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30632, "cache_tensor_bytes": 237957120, "serialized_payload_bytes": 237957120, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1047.6557079236954, "ttft_ms": 49.681207980029285, "decode_ms": 105.38004199042916, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1207.3754579760134, "ttft_ms": 49.681207980029285, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 1279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "899f2e78900aeaca31d086a7", "attempt_id": "9109b5c33c25", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:52.072108Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237957120}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 48, "message_tokens": null, "message_utf8_bytes": 30632, "cache_tensor_bytes": 237957120, "serialized_payload_bytes": 237957120, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1047.6557079236954, "ttft_ms": 49.68554200604558, "decode_ms": 15.216332976706326, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1117.1349169453606, "ttft_ms": 49.68554200604558, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1bf53c172495f7685ea481fb", "attempt_id": "7bfbd8389173", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:52.160007Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237957120}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5828, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 30632, "cache_tensor_bytes": 237957120, "serialized_payload_bytes": 237957120, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1047.6557079236954, "ttft_ms": 47.359707998111844, "decode_ms": 15.107375103980303, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1114.7937079658732, "ttft_ms": 47.359707998111844, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Selbanwen-10", "bogus_amount": "6,245,875", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "40c04ffc8e76879bfeb124c9", "attempt_id": "0b039921526f", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:53.163218Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2498, "message_tokens": 2414, "message_utf8_bytes": 8564, "cache_tensor_bytes": null, "serialized_payload_bytes": 8564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.030542025342583656, "ttft_ms": 13.566375011578202, "decode_ms": 94.80612503830343, "receiver_prefill_ms": 282.27895905729383}, "total_wall_ms": 395.0876259477809, "ttft_ms": 13.566375011578202, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4e9184df87a0cd5d465ab41f2efd29c7b77745ad3e4835c197306f8c37079e93", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | ||||
| 1282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "587a2b30b13426e98aaf904d", "attempt_id": "f244c00581a3", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:53.576136Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2502, "message_tokens": 2414, "message_utf8_bytes": 8564, "cache_tensor_bytes": null, "serialized_payload_bytes": 8564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.030542025342583656, "ttft_ms": 13.44966609030962, "decode_ms": 134.54345799982548, "receiver_prefill_ms": 271.2700000265613}, "total_wall_ms": 425.94708397518843, "ttft_ms": 13.44966609030962, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-20T-7883", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4e9184df87a0cd5d465ab41f2efd29c7b77745ad3e4835c197306f8c37079e93", "output_hash": "dd2e4bce724b0497351a41dbf71da774970bfcbe2553b73571a02bc7e8fa0e53"} | ||||
| 1283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c3d53286ed5d622b0bfecbcd", "attempt_id": "aaf4f233720a", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:54.016419Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2509, "message_tokens": 2414, "message_utf8_bytes": 8564, "cache_tensor_bytes": null, "serialized_payload_bytes": 8564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.030542025342583656, "ttft_ms": 13.807207928039134, "decode_ms": 95.26216692756861, "receiver_prefill_ms": 271.1039580171928}, "total_wall_ms": 384.1880839318037, "ttft_ms": 13.807207928039134, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6786800", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4e9184df87a0cd5d465ab41f2efd29c7b77745ad3e4835c197306f8c37079e93", "output_hash": "33cee35795111ffd7720bcc954c699ed0ef5e51fe4ea1091cab2d69cd6de104f"} | ||||
| 1284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "87d33ef10cd19995de0abb69", "attempt_id": "da307c6284db", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:54.415688Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2500, "message_tokens": 2414, "message_utf8_bytes": 8564, "cache_tensor_bytes": null, "serialized_payload_bytes": 8564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.030542025342583656, "ttft_ms": 14.262999990023673, "decode_ms": 124.98570792376995, "receiver_prefill_ms": 271.1082500172779}, "total_wall_ms": 414.1628759680316, "ttft_ms": 14.262999990023673, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,810,500", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4e9184df87a0cd5d465ab41f2efd29c7b77745ad3e4835c197306f8c37079e93", "output_hash": "7810d312d2690f45bb13651b3c1cf9a2098b9e9d043463aaccc81157fad4a26e"} | ||||
| 1285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "dabc91782f625c51f85143e8", "attempt_id": "bceff53d1ab0", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:54.843795Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2510, "message_tokens": 2414, "message_utf8_bytes": 8564, "cache_tensor_bytes": null, "serialized_payload_bytes": 8564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.030542025342583656, "ttft_ms": 13.756499974988401, "decode_ms": 81.98524999897927, "receiver_prefill_ms": 274.6542498935014}, "total_wall_ms": 379.3360011186451, "ttft_ms": 13.756499974988401, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quidra-11", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4e9184df87a0cd5d465ab41f2efd29c7b77745ad3e4835c197306f8c37079e93", "output_hash": "41698c622e83fd669a8d097b3f00cb4197b0a66bac5aeca05b6224ada8b9dd5d"} | ||||
| 1286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a74560e348184248cbc606d7", "attempt_id": "3e4aa0e32475", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:55.238005Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2503, "message_tokens": 2414, "message_utf8_bytes": 8564, "cache_tensor_bytes": null, "serialized_payload_bytes": 8564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.030542025342583656, "ttft_ms": 13.611166970804334, "decode_ms": 135.92820905614644, "receiver_prefill_ms": 273.4401250490919}, "total_wall_ms": 426.7311670118943, "ttft_ms": 13.611166970804334, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "42,050,330", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4e9184df87a0cd5d465ab41f2efd29c7b77745ad3e4835c197306f8c37079e93", "output_hash": "6306e3124ddb9d73a354dce7add522b5e4bb245962bf0f7c09537621a96c30b5"} | ||||
| 1287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8544b8a2f8072cc1982929ab", "attempt_id": "799152cb7a5c", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:55.678748Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2504, "message_tokens": 2414, "message_utf8_bytes": 8564, "cache_tensor_bytes": null, "serialized_payload_bytes": 8564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.030542025342583656, "ttft_ms": 13.363540987484157, "decode_ms": 13.921667006798089, "receiver_prefill_ms": 270.2587080420926}, "total_wall_ms": 301.2395000550896, "ttft_ms": 13.363540987484157, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4e9184df87a0cd5d465ab41f2efd29c7b77745ad3e4835c197306f8c37079e93", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "eb3a23d297cbe608c195b7b9", "attempt_id": "fb82ca04943f", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:30:55.993975Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2505, "message_tokens": 2414, "message_utf8_bytes": 8564, "cache_tensor_bytes": null, "serialized_payload_bytes": 8564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.030542025342583656, "ttft_ms": 13.556667021475732, "decode_ms": 13.639707933180034, "receiver_prefill_ms": 271.27550006844103}, "total_wall_ms": 302.1440840093419, "ttft_ms": 13.556667021475732, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4e9184df87a0cd5d465ab41f2efd29c7b77745ad3e4835c197306f8c37079e93", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "212c4ba92d939cf4495ee1d4", "attempt_id": "be6a3641dce3", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:10.416782Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1122, "message_tokens": 1037, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14106.442834017798, "ttft_ms": 13.415291905403137, "decode_ms": 94.56825000233948, "receiver_prefill_ms": 122.01437493786216}, "total_wall_ms": 14338.359251036309, "ttft_ms": 13.415291905403137, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ae4d4d02d5d15b5daa692263d634313c88e96ac068a189d8c115e529c43ff39d", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | ||||
| 1290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "944620e6b89d44c34fbe2bc2", "attempt_id": "f575452d8c67", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:10.663287Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1126, "message_tokens": 1037, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14106.442834017798, "ttft_ms": 13.482582988217473, "decode_ms": 134.18254198040813, "receiver_prefill_ms": 121.90004205331206}, "total_wall_ms": 14377.818958950229, "ttft_ms": 13.482582988217473, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-20T-7883", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ae4d4d02d5d15b5daa692263d634313c88e96ac068a189d8c115e529c43ff39d", "output_hash": "dd2e4bce724b0497351a41dbf71da774970bfcbe2553b73571a02bc7e8fa0e53"} | ||||
| 1291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "681e424fd1720577dbef1cd1", "attempt_id": "02fa8ab49fd6", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:10.948778Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1133, "message_tokens": 1037, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14106.442834017798, "ttft_ms": 13.485042029060423, "decode_ms": 121.07954209204763, "receiver_prefill_ms": 121.89658300485462}, "total_wall_ms": 14364.784084027633, "ttft_ms": 13.485042029060423, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,786,800", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ae4d4d02d5d15b5daa692263d634313c88e96ac068a189d8c115e529c43ff39d", "output_hash": "396a4b6b618fb10a20ca84793c54e794cbfebea7547dd351971f763f30153ef9"} | ||||
| 1292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "dae5030a0f42d02d6921cbe3", "attempt_id": "b61c7ff3b0ec", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:11.221070Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1124, "message_tokens": 1037, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14106.442834017798, "ttft_ms": 13.426209101453424, "decode_ms": 94.41970800980926, "receiver_prefill_ms": 121.1685830494389}, "total_wall_ms": 14337.342917104252, "ttft_ms": 13.426209101453424, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7510570", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ae4d4d02d5d15b5daa692263d634313c88e96ac068a189d8c115e529c43ff39d", "output_hash": "410d7d10eb5e18b187a54949b6517bffab264255a8ac37e64c7fa5b57e44d9ed"} | ||||
| 1293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6656ba040d1d285c18734a57", "attempt_id": "f68e0f5202ad", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:11.465875Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1134, "message_tokens": 1037, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14106.442834017798, "ttft_ms": 13.432958978228271, "decode_ms": 80.76499996241182, "receiver_prefill_ms": 121.36554205790162}, "total_wall_ms": 14323.872125940397, "ttft_ms": 13.432958978228271, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quilun-16", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ae4d4d02d5d15b5daa692263d634313c88e96ac068a189d8c115e529c43ff39d", "output_hash": "34a7c0e11c93ba75eb4b20d3d3f5303b417856d89a232e8b16fef75c4336afc6"} | ||||
| 1294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6dead528c8b7412e99109fdf", "attempt_id": "25efc85f102d", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:11.697413Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1127, "message_tokens": 1037, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14106.442834017798, "ttft_ms": 13.51770805194974, "decode_ms": 134.3944170512259, "receiver_prefill_ms": 120.95116602722555}, "total_wall_ms": 14377.248583943583, "ttft_ms": 13.51770805194974, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "32,577,719", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ae4d4d02d5d15b5daa692263d634313c88e96ac068a189d8c115e529c43ff39d", "output_hash": "bcb604e76cda7a500e75221be955eba37a37232877302c549bc895816d55ba73"} | ||||
| 1295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3ad96b2ade930f877015f88e", "attempt_id": "b7585c3b86e9", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:11.982534Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1128, "message_tokens": 1037, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14106.442834017798, "ttft_ms": 13.517333078198135, "decode_ms": 13.72904097661376, "receiver_prefill_ms": 120.82354188896716}, "total_wall_ms": 14256.329125026241, "ttft_ms": 13.517333078198135, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ae4d4d02d5d15b5daa692263d634313c88e96ac068a189d8c115e529c43ff39d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "103a3b5dcce005e7de1a8cb5", "attempt_id": "c904952dd07e", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:12.146185Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1129, "message_tokens": 1037, "message_utf8_bytes": 2682, "cache_tensor_bytes": null, "serialized_payload_bytes": 2682, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14106.442834017798, "ttft_ms": 13.342999969609082, "decode_ms": 13.240540982224047, "receiver_prefill_ms": 121.14233407191932}, "total_wall_ms": 14255.988417076878, "ttft_ms": 13.342999969609082, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ae4d4d02d5d15b5daa692263d634313c88e96ac068a189d8c115e529c43ff39d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "aafb5a397358863c106c1bb9", "attempt_id": "2dee65fe2f36", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:24.824881Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 584, "message_tokens": 495, "message_utf8_bytes": 1363, "cache_tensor_bytes": null, "serialized_payload_bytes": 1363, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.18854207825, "ttft_ms": 13.558125006966293, "decode_ms": 13.425957993604243, "receiver_prefill_ms": 69.91595798172057}, "total_wall_ms": 12613.347416976467, "ttft_ms": 13.558125006966293, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b0b7513f495aab95aaf60ea9bb746e048270259dd15a42b334b89a5585522417", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "cc677eaae4e7a2e0d2490ff5", "attempt_id": "20f334bc6a91", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:24.937918Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 588, "message_tokens": 495, "message_utf8_bytes": 1363, "cache_tensor_bytes": null, "serialized_payload_bytes": 1363, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.18854207825, "ttft_ms": 13.247665949165821, "decode_ms": 13.465916970744729, "receiver_prefill_ms": 69.78424999397248}, "total_wall_ms": 12612.862750072964, "ttft_ms": 13.247665949165821, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b0b7513f495aab95aaf60ea9bb746e048270259dd15a42b334b89a5585522417", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "181a9728291b0da178001020", "attempt_id": "e586c683b6a7", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:25.049632Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 495, "message_utf8_bytes": 1363, "cache_tensor_bytes": null, "serialized_payload_bytes": 1363, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.18854207825, "ttft_ms": 13.63187504466623, "decode_ms": 13.1967089837417, "receiver_prefill_ms": 69.63366596028209}, "total_wall_ms": 12612.848667078651, "ttft_ms": 13.63187504466623, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b0b7513f495aab95aaf60ea9bb746e048270259dd15a42b334b89a5585522417", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c5f74a20b6325bb5cb9f1a03", "attempt_id": "804a9110ce80", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:25.161229Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 586, "message_tokens": 495, "message_utf8_bytes": 1363, "cache_tensor_bytes": null, "serialized_payload_bytes": 1363, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.18854207825, "ttft_ms": 13.486499898135662, "decode_ms": 13.725540949963033, "receiver_prefill_ms": 69.51070809736848}, "total_wall_ms": 12613.076084060594, "ttft_ms": 13.486499898135662, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b0b7513f495aab95aaf60ea9bb746e048270259dd15a42b334b89a5585522417", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d1eff5b610e2a18ad9ae6c69", "attempt_id": "81d6314f8fe4", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:25.273063Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 495, "message_utf8_bytes": 1363, "cache_tensor_bytes": null, "serialized_payload_bytes": 1363, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.18854207825, "ttft_ms": 13.119707931764424, "decode_ms": 79.7553330194205, "receiver_prefill_ms": 69.46679204702377}, "total_wall_ms": 12678.766376106068, "ttft_ms": 13.119707931764424, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Draard-12", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b0b7513f495aab95aaf60ea9bb746e048270259dd15a42b334b89a5585522417", "output_hash": "c98ed1d4a10f5c2d70e15663c4ed0df74b420086785b671165017dfed27dee41"} | ||||
| 1302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "97981d54106a5f9841d26521", "attempt_id": "195923a5bdf5", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:25.450891Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 589, "message_tokens": 495, "message_utf8_bytes": 1363, "cache_tensor_bytes": null, "serialized_payload_bytes": 1363, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.18854207825, "ttft_ms": 13.343999977223575, "decode_ms": 93.33691699430346, "receiver_prefill_ms": 69.34654095675796}, "total_wall_ms": 12692.408458096907, "ttft_ms": 13.343999977223575, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b0b7513f495aab95aaf60ea9bb746e048270259dd15a42b334b89a5585522417", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 1303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1407ec4021733dbee950003a", "attempt_id": "26602c8e8ee1", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:25.641953Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 590, "message_tokens": 495, "message_utf8_bytes": 1363, "cache_tensor_bytes": null, "serialized_payload_bytes": 1363, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.18854207825, "ttft_ms": 13.271415955387056, "decode_ms": 13.361167046241462, "receiver_prefill_ms": 69.67112503480166}, "total_wall_ms": 12612.690209178254, "ttft_ms": 13.271415955387056, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b0b7513f495aab95aaf60ea9bb746e048270259dd15a42b334b89a5585522417", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3ff747f08168df1f8de20f59", "attempt_id": "1bfce3ccec29", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:25.753596Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 13}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 591, "message_tokens": 495, "message_utf8_bytes": 1363, "cache_tensor_bytes": null, "serialized_payload_bytes": 1363, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.18854207825, "ttft_ms": 13.252458069473505, "decode_ms": 13.157709036022425, "receiver_prefill_ms": 69.44150000344962}, "total_wall_ms": 12612.151834066026, "ttft_ms": 13.252458069473505, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b0b7513f495aab95aaf60ea9bb746e048270259dd15a42b334b89a5585522417", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2e28fcf23d2c72b1304c359c", "attempt_id": "b1e25fb2d292", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:38.379802Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1397, "message_tokens": 1309, "message_utf8_bytes": 3271, "cache_tensor_bytes": null, "serialized_payload_bytes": 3271, "side_information_bytes": 0, "fetched_bytes": 1790, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.177167020738, "ttft_ms": 13.57225002720952, "decode_ms": 94.59033398889005, "receiver_prefill_ms": 148.48066691774875}, "total_wall_ms": 12773.999167024158, "ttft_ms": 13.57225002720952, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4a88b73a8ccb18945474231c18c56dd9cf1e6060f34547e483e5ea652a087815", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | ||||
| 1306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e5412bb9358f4c35b80262f9", "attempt_id": "4d7ac4198314", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:38.654072Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1368, "message_tokens": 1276, "message_utf8_bytes": 3188, "cache_tensor_bytes": null, "serialized_payload_bytes": 3188, "side_information_bytes": 0, "fetched_bytes": 1710, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.177167020738, "ttft_ms": 13.374125002883375, "decode_ms": 13.208957971073687, "receiver_prefill_ms": 144.81504203286022}, "total_wall_ms": 12688.624042086303, "ttft_ms": 13.374125002883375, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ffff6ea4abd0ba6ff6525a96e7c48600de08addd5f854fd3b688b2f3cd1f1e08", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b98b3dc48b11c5d30c2d6681", "attempt_id": "ae7e33fb0a47", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:38.841385Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1408, "message_tokens": 1309, "message_utf8_bytes": 3271, "cache_tensor_bytes": null, "serialized_payload_bytes": 3271, "side_information_bytes": 0, "fetched_bytes": 1790, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.177167020738, "ttft_ms": 13.490332989022136, "decode_ms": 13.323208084329963, "receiver_prefill_ms": 148.87733396608382}, "total_wall_ms": 12692.991917021573, "ttft_ms": 13.490332989022136, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4a88b73a8ccb18945474231c18c56dd9cf1e6060f34547e483e5ea652a087815", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "55e25b9a4020b6012f4b9ce7", "attempt_id": "20f7f3c95157", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:39.034292Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1399, "message_tokens": 1309, "message_utf8_bytes": 3271, "cache_tensor_bytes": null, "serialized_payload_bytes": 3271, "side_information_bytes": 0, "fetched_bytes": 1790, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.177167020738, "ttft_ms": 13.373833033256233, "decode_ms": 94.83158309012651, "receiver_prefill_ms": 148.91783299390227}, "total_wall_ms": 12774.377208086662, "ttft_ms": 13.373833033256233, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7510570", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "923289d96e921e46621d25ce69d26d0f453ecf0b6e66e67bfc18366cc6d76587", "output_hash": "410d7d10eb5e18b187a54949b6517bffab264255a8ac37e64c7fa5b57e44d9ed"} | ||||
| 1309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "931267ce168e3611bd809c9b", "attempt_id": "9b6a3a90e659", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:39.307334Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1405, "message_tokens": 1305, "message_utf8_bytes": 3270, "cache_tensor_bytes": null, "serialized_payload_bytes": 3270, "side_information_bytes": 0, "fetched_bytes": 1787, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.177167020738, "ttft_ms": 13.56566697359085, "decode_ms": 80.08491701912135, "receiver_prefill_ms": 148.89662503264844}, "total_wall_ms": 12759.98579210136, "ttft_ms": 13.56566697359085, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Draard-12", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e2b3037d8908da06298f667c318fdee9bfa5c1b9e0d87cba8cdbc052ed0bee9a", "output_hash": "c98ed1d4a10f5c2d70e15663c4ed0df74b420086785b671165017dfed27dee41"} | ||||
| 1310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "82a8599d60aa70c2e5515b6f", "attempt_id": "dfbff9d583b2", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:39.566815Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1402, "message_tokens": 1309, "message_utf8_bytes": 3271, "cache_tensor_bytes": null, "serialized_payload_bytes": 3271, "side_information_bytes": 0, "fetched_bytes": 1790, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.177167020738, "ttft_ms": 13.415834051556885, "decode_ms": 108.37150004226714, "receiver_prefill_ms": 148.01033306866884}, "total_wall_ms": 12787.11758297868, "ttft_ms": 13.415834051556885, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "26748811", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4a88b73a8ccb18945474231c18c56dd9cf1e6060f34547e483e5ea652a087815", "output_hash": "d49d87bb3b997d06c0986aed2e51ae3910ffbbc442a2f12cfe5239c2da5e9353"} | ||||
| 1311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "27cb3091caf3805f9223f66a", "attempt_id": "d7d6b5a93946", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:39.852696Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1391, "message_tokens": 1297, "message_utf8_bytes": 3259, "cache_tensor_bytes": null, "serialized_payload_bytes": 3259, "side_information_bytes": 0, "fetched_bytes": 1771, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.177167020738, "ttft_ms": 13.529125018976629, "decode_ms": 13.386375037953258, "receiver_prefill_ms": 148.83320801891387}, "total_wall_ms": 12693.106333026662, "ttft_ms": 13.529125018976629, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "308afd5f5d91e3e5623fb013b660fe534657ff7706da0041c6a822c06c814e97", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8caf002abd225f4f55990119", "attempt_id": "a647fc9864e3", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:40.045379Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1404, "message_tokens": 1309, "message_utf8_bytes": 3271, "cache_tensor_bytes": null, "serialized_payload_bytes": 3271, "side_information_bytes": 0, "fetched_bytes": 1790, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12515.177167020738, "ttft_ms": 13.566749985329807, "decode_ms": 13.344415929168463, "receiver_prefill_ms": 148.42520805541426}, "total_wall_ms": 12692.65387498308, "ttft_ms": 13.566749985329807, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "da7ea632e2f2b1db4e344cab53e795cea56f3fad706e86cc719fcc96ffc0e31d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "55e09c3560e9084a9c0150b4", "attempt_id": "dc3af018ce62", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:40.532560Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 91865088}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 42, "message_tokens": null, "message_utf8_bytes": 8538, "cache_tensor_bytes": 91865088, "serialized_payload_bytes": 91865088, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 295.14358402229846, "ttft_ms": 34.026875044219196, "decode_ms": 98.1809999793768, "receiver_prefill_ms": 0.0}, "total_wall_ms": 431.9698759354651, "ttft_ms": 34.026875044219196, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 1314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c248e8f65d3f8df84c1d68b0", "attempt_id": "d535d06a9b33", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:40.683414Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 91865088}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 46, "message_tokens": null, "message_utf8_bytes": 8538, "cache_tensor_bytes": 91865088, "serialized_payload_bytes": 91865088, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 295.14358402229846, "ttft_ms": 28.9333340479061, "decode_ms": 140.4450419358909, "receiver_prefill_ms": 0.0}, "total_wall_ms": 468.22804294060916, "ttft_ms": 28.9333340479061, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-20T-7883", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "dd2e4bce724b0497351a41dbf71da774970bfcbe2553b73571a02bc7e8fa0e53"} | ||||
| 1315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d7aecbf8fbca4d67c846acaf", "attempt_id": "67c0b0c9fb2a", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:40.870272Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 91865088}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 53, "message_tokens": null, "message_utf8_bytes": 8538, "cache_tensor_bytes": 91865088, "serialized_payload_bytes": 91865088, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 295.14358402229846, "ttft_ms": 29.38929107040167, "decode_ms": 97.74766699410975, "receiver_prefill_ms": 0.0}, "total_wall_ms": 426.3515010243282, "ttft_ms": 29.38929107040167, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6786800", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "33cee35795111ffd7720bcc954c699ed0ef5e51fe4ea1091cab2d69cd6de104f"} | ||||
| 1316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "54309fb3c9e431b014616f64", "attempt_id": "d78809cd372b", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:41.015819Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 91865088}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 8538, "cache_tensor_bytes": 91865088, "serialized_payload_bytes": 91865088, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 295.14358402229846, "ttft_ms": 28.124709031544626, "decode_ms": 125.67083304747939, "receiver_prefill_ms": 0.0}, "total_wall_ms": 453.0987510224804, "ttft_ms": 28.124709031544626, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,448,780", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "16bc7be434494b015249be21e11fa0b76d9a1d0019bef3e4aa915ad0774d29d1"} | ||||
| 1317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8876250356a1a122bc187aea", "attempt_id": "c8c5f5ace8b9", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:41.188215Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 91865088}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 54, "message_tokens": null, "message_utf8_bytes": 8538, "cache_tensor_bytes": 91865088, "serialized_payload_bytes": 91865088, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 295.14358402229846, "ttft_ms": 29.017874971032143, "decode_ms": 84.32183298282325, "receiver_prefill_ms": 0.0}, "total_wall_ms": 412.3372919857502, "ttft_ms": 29.017874971032143, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Draard-12", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c98ed1d4a10f5c2d70e15663c4ed0df74b420086785b671165017dfed27dee41"} | ||||
| 1318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ba1101631fb0743c4c5946b2", "attempt_id": "49782b1f6476", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:41.319314Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 91865088}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 8538, "cache_tensor_bytes": 91865088, "serialized_payload_bytes": 91865088, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 295.14358402229846, "ttft_ms": 29.218041920103133, "decode_ms": 139.21016594395041, "receiver_prefill_ms": 0.0}, "total_wall_ms": 467.72679209243506, "ttft_ms": 29.218041920103133, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "31,964,570", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "439c7a5ac9d6bc24375211ea55b790b894a6911b8f28b92268fc9325d62aecce"} | ||||
| 1319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "04452384f3dcd11c6e19765d", "attempt_id": "232081c701b7", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:41.506416Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 91865088}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 48, "message_tokens": null, "message_utf8_bytes": 8538, "cache_tensor_bytes": 91865088, "serialized_payload_bytes": 91865088, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 295.14358402229846, "ttft_ms": 28.19379197899252, "decode_ms": 13.820708030834794, "receiver_prefill_ms": 0.0}, "total_wall_ms": 341.1353341070935, "ttft_ms": 28.19379197899252, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "76993531052a5587b47b42df", "attempt_id": "a62869141be0", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:41.566873Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 91865088}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 8538, "cache_tensor_bytes": 91865088, "serialized_payload_bytes": 91865088, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 295.14358402229846, "ttft_ms": 29.5503749512136, "decode_ms": 13.893625000491738, "receiver_prefill_ms": 0.0}, "total_wall_ms": 342.7290430990979, "ttft_ms": 29.5503749512136, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a579979c20361ab60cbc7ca0", "attempt_id": "5e25257ae815", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:41.628563Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2612, "message_tokens": 2528, "message_utf8_bytes": 9068, "cache_tensor_bytes": null, "serialized_payload_bytes": 9068, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.023875036276876926, "ttft_ms": 13.653250061906874, "decode_ms": 121.35220807977021, "receiver_prefill_ms": 283.6981250438839}, "total_wall_ms": 422.5835420656949, "ttft_ms": 13.653250061906874, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,453,600", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c06d757517ca8904b6f50914a780c15f35e8e0ba06e49f03c985c0581d1dceb3", "output_hash": "e6a2b25d3f99c6c8c339dc11738104244c59975cc325ebc53bc602e40b327216"} | ||||
| 1322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "43430ca106f4c77cdc38a804", "attempt_id": "2c6f30cb5865", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:42.065480Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2616, "message_tokens": 2528, "message_utf8_bytes": 9068, "cache_tensor_bytes": null, "serialized_payload_bytes": 9068, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.023875036276876926, "ttft_ms": 13.439749949611723, "decode_ms": 134.8626249236986, "receiver_prefill_ms": 282.55808306857944}, "total_wall_ms": 434.8005000501871, "ttft_ms": 13.439749949611723, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-20T-7883", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c06d757517ca8904b6f50914a780c15f35e8e0ba06e49f03c985c0581d1dceb3", "output_hash": "dd2e4bce724b0497351a41dbf71da774970bfcbe2553b73571a02bc7e8fa0e53"} | ||||
| 1323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4405f540d43eefd4de7c2e3f", "attempt_id": "327ff18f3f80", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:42.514326Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2623, "message_tokens": 2528, "message_utf8_bytes": 9068, "cache_tensor_bytes": null, "serialized_payload_bytes": 9068, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.023875036276876926, "ttft_ms": 13.55433405842632, "decode_ms": 94.01562495622784, "receiver_prefill_ms": 283.1187079427764}, "total_wall_ms": 394.6062079630792, "ttft_ms": 13.55433405842632, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6786800", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c06d757517ca8904b6f50914a780c15f35e8e0ba06e49f03c985c0581d1dceb3", "output_hash": "33cee35795111ffd7720bcc954c699ed0ef5e51fe4ea1091cab2d69cd6de104f"} | ||||
| 1324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "00ff4590225e33950b1eafb5", "attempt_id": "28962261fe14", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:42.924073Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2614, "message_tokens": 2528, "message_utf8_bytes": 9068, "cache_tensor_bytes": null, "serialized_payload_bytes": 9068, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.023875036276876926, "ttft_ms": 13.53074994403869, "decode_ms": 122.08979192655534, "receiver_prefill_ms": 283.10379199683666}, "total_wall_ms": 422.6961249951273, "ttft_ms": 13.53074994403869, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,810,500", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c06d757517ca8904b6f50914a780c15f35e8e0ba06e49f03c985c0581d1dceb3", "output_hash": "7810d312d2690f45bb13651b3c1cf9a2098b9e9d043463aaccc81157fad4a26e"} | ||||
| 1325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8c1936812d1717cb77bb9593", "attempt_id": "a195f3ae066f", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:43.360940Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2624, "message_tokens": 2528, "message_utf8_bytes": 9068, "cache_tensor_bytes": null, "serialized_payload_bytes": 9068, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.023875036276876926, "ttft_ms": 13.666000100784004, "decode_ms": 81.60508295986801, "receiver_prefill_ms": 283.1953330896795}, "total_wall_ms": 382.3897500988096, "ttft_ms": 13.666000100784004, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quidra-11", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c06d757517ca8904b6f50914a780c15f35e8e0ba06e49f03c985c0581d1dceb3", "output_hash": "41698c622e83fd669a8d097b3f00cb4197b0a66bac5aeca05b6224ada8b9dd5d"} | ||||
| 1326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6f02a6b0e9290601a8b7ee07", "attempt_id": "ee0547ff2f4f", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:43.757494Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2617, "message_tokens": 2528, "message_utf8_bytes": 9068, "cache_tensor_bytes": null, "serialized_payload_bytes": 9068, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.023875036276876926, "ttft_ms": 13.743832940235734, "decode_ms": 135.3820830117911, "receiver_prefill_ms": 293.2795420056209}, "total_wall_ms": 446.3246250525117, "ttft_ms": 13.743832940235734, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "40,045,313", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c06d757517ca8904b6f50914a780c15f35e8e0ba06e49f03c985c0581d1dceb3", "output_hash": "e4df8dcf50c0cc11dacc1076e0717d84e5c0de040065c7bcdf59c1723f02ac29"} | ||||
| 1327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "41fe49b2eee4f73d8ab0d446", "attempt_id": "132b6a26a5d2", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:44.218414Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2618, "message_tokens": 2528, "message_utf8_bytes": 9068, "cache_tensor_bytes": null, "serialized_payload_bytes": 9068, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.023875036276876926, "ttft_ms": 13.723165960982442, "decode_ms": 13.57287506107241, "receiver_prefill_ms": 283.7702500401065}, "total_wall_ms": 315.027084085159, "ttft_ms": 13.723165960982442, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c06d757517ca8904b6f50914a780c15f35e8e0ba06e49f03c985c0581d1dceb3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1fb227206e36ddc7b6e6981b", "attempt_id": "e2de69a26b1d", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:31:44.547905Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2619, "message_tokens": 2528, "message_utf8_bytes": 9068, "cache_tensor_bytes": null, "serialized_payload_bytes": 9068, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.023875036276876926, "ttft_ms": 13.76029197126627, "decode_ms": 13.69058305863291, "receiver_prefill_ms": 292.853832943365}, "total_wall_ms": 324.09112504683435, "ttft_ms": 13.76029197126627, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c06d757517ca8904b6f50914a780c15f35e8e0ba06e49f03c985c0581d1dceb3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ca62bdceecb33759a381b20e", "attempt_id": "d627a5ed989b", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:08.197901Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1711}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1820, "message_tokens": 1735, "message_utf8_bytes": 5015, "cache_tensor_bytes": null, "serialized_payload_bytes": 5015, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23311.22629204765, "ttft_ms": 13.842749991454184, "decode_ms": 94.3367499858141, "receiver_prefill_ms": 194.15091595146805}, "total_wall_ms": 23617.153001134284, "ttft_ms": 13.842749991454184, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0136aaee0b0c82e32b67ba5041e0cf3293a498bd9a294b0841d9787366b3680b", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | ||||
| 1330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "461c10f16fe4d9d6ec66d7e1", "attempt_id": "360c688e0d97", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:08.518354Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1711}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1824, "message_tokens": 1735, "message_utf8_bytes": 5015, "cache_tensor_bytes": null, "serialized_payload_bytes": 5015, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23311.22629204765, "ttft_ms": 13.498624903149903, "decode_ms": 134.37291607260704, "receiver_prefill_ms": 194.57941700238734}, "total_wall_ms": 23656.23970911838, "ttft_ms": 13.498624903149903, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-20T-7883", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0136aaee0b0c82e32b67ba5041e0cf3293a498bd9a294b0841d9787366b3680b", "output_hash": "dd2e4bce724b0497351a41dbf71da774970bfcbe2553b73571a02bc7e8fa0e53"} | ||||
| 1331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6d5043d6d7fbf2239beec5dd", "attempt_id": "bf5c85947a74", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:08.877918Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1711}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1831, "message_tokens": 1735, "message_utf8_bytes": 5015, "cache_tensor_bytes": null, "serialized_payload_bytes": 5015, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23311.22629204765, "ttft_ms": 13.351083034649491, "decode_ms": 94.77112500462681, "receiver_prefill_ms": 195.53579099010676}, "total_wall_ms": 23617.5482920371, "ttft_ms": 13.351083034649491, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5821605", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0136aaee0b0c82e32b67ba5041e0cf3293a498bd9a294b0841d9787366b3680b", "output_hash": "66b2a9269bfd2b9ccbe3cf3b211a218de7702bc720ef7b486355c83813fdaed3"} | ||||
| 1332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1a80d50aef8fa81041938b79", "attempt_id": "014ab596ad44", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:09.198521Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1711}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1822, "message_tokens": 1735, "message_utf8_bytes": 5015, "cache_tensor_bytes": null, "serialized_payload_bytes": 5015, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23311.22629204765, "ttft_ms": 13.587750028818846, "decode_ms": 95.77037510462105, "receiver_prefill_ms": 192.7806659368798}, "total_wall_ms": 23616.11266701948, "ttft_ms": 13.587750028818846, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7510570", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0136aaee0b0c82e32b67ba5041e0cf3293a498bd9a294b0841d9787366b3680b", "output_hash": "410d7d10eb5e18b187a54949b6517bffab264255a8ac37e64c7fa5b57e44d9ed"} | ||||
| 1333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "99a031e24a87ef6847a85c0d", "attempt_id": "0b31ea4ee052", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:09.517813Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1711}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1832, "message_tokens": 1735, "message_utf8_bytes": 5015, "cache_tensor_bytes": null, "serialized_payload_bytes": 5015, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23311.22629204765, "ttft_ms": 13.879625010304153, "decode_ms": 81.87324996106327, "receiver_prefill_ms": 194.44316590670496}, "total_wall_ms": 23604.112416971475, "ttft_ms": 13.879625010304153, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Draard-12", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0136aaee0b0c82e32b67ba5041e0cf3293a498bd9a294b0841d9787366b3680b", "output_hash": "c98ed1d4a10f5c2d70e15663c4ed0df74b420086785b671165017dfed27dee41"} | ||||
| 1334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a77e1f971cdbbb02fe196146", "attempt_id": "123eeb0359ea", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:09.824747Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1711}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1825, "message_tokens": 1735, "message_utf8_bytes": 5015, "cache_tensor_bytes": null, "serialized_payload_bytes": 5015, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23311.22629204765, "ttft_ms": 13.925459003075957, "decode_ms": 94.652249943465, "receiver_prefill_ms": 199.0933750057593}, "total_wall_ms": 23621.620875084773, "ttft_ms": 13.925459003075957, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3484480", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0136aaee0b0c82e32b67ba5041e0cf3293a498bd9a294b0841d9787366b3680b", "output_hash": "63cfa217c09892c2da9620cdc79438d18a8f82a38c8adf7ef814d6aad1974f6e"} | ||||
| 1335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8ed56f57f11c22ed38f48d1b", "attempt_id": "2e9de55b5779", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:10.150097Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1711}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1826, "message_tokens": 1735, "message_utf8_bytes": 5015, "cache_tensor_bytes": null, "serialized_payload_bytes": 5015, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23311.22629204765, "ttft_ms": 14.270749990828335, "decode_ms": 14.437415986321867, "receiver_prefill_ms": 853.6735830130056}, "total_wall_ms": 24196.421584114432, "ttft_ms": 14.270749990828335, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0136aaee0b0c82e32b67ba5041e0cf3293a498bd9a294b0841d9787366b3680b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a1f2798d105cebbdf7c8dc74", "attempt_id": "e58929aaf0ec", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:11.051389Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1711}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1827, "message_tokens": 1735, "message_utf8_bytes": 5015, "cache_tensor_bytes": null, "serialized_payload_bytes": 5015, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 23311.22629204765, "ttft_ms": 14.310833066701889, "decode_ms": 14.01895796880126, "receiver_prefill_ms": 1000.5094589432701}, "total_wall_ms": 24343.141708988696, "ttft_ms": 14.310833066701889, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0136aaee0b0c82e32b67ba5041e0cf3293a498bd9a294b0841d9787366b3680b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "31a14f912be37878c8241001", "attempt_id": "5934ad41cbac", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:39.432746Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 30}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1238, "message_tokens": 1149, "message_utf8_bytes": 3043, "cache_tensor_bytes": null, "serialized_payload_bytes": 3043, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27333.36341707036, "ttft_ms": 14.396667014807463, "decode_ms": 121.00066698621958, "receiver_prefill_ms": 135.93758293427527}, "total_wall_ms": 27610.006709117442, "ttft_ms": 14.396667014807463, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2dd52fe72ca47aacd0e383e165bc8f70c1b82d5f1667eeca84e795e754cd28a2", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 1338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4f966ec893d730ab8393d2e6", "attempt_id": "34d5a45f5cc3", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:39.729827Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 30}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1242, "message_tokens": 1149, "message_utf8_bytes": 3043, "cache_tensor_bytes": null, "serialized_payload_bytes": 3043, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27333.36341707036, "ttft_ms": 13.823208981193602, "decode_ms": 14.106916962191463, "receiver_prefill_ms": 151.01191599387676}, "total_wall_ms": 27514.223334146664, "ttft_ms": 13.823208981193602, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2dd52fe72ca47aacd0e383e165bc8f70c1b82d5f1667eeca84e795e754cd28a2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "981b0f71877380b1257db25c", "attempt_id": "27760b4ba384", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:39.925244Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 30}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1249, "message_tokens": 1149, "message_utf8_bytes": 3043, "cache_tensor_bytes": null, "serialized_payload_bytes": 3043, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27333.36341707036, "ttft_ms": 13.963583041913807, "decode_ms": 124.56249992828816, "receiver_prefill_ms": 193.1782920146361}, "total_wall_ms": 27667.046417016536, "ttft_ms": 13.963583041913807, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,786,800", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2dd52fe72ca47aacd0e383e165bc8f70c1b82d5f1667eeca84e795e754cd28a2", "output_hash": "396a4b6b618fb10a20ca84793c54e794cbfebea7547dd351971f763f30153ef9"} | ||||
| 1340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b27b935d778dc2335edab948", "attempt_id": "105f8bef7472", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:40.274052Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 30}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1240, "message_tokens": 1149, "message_utf8_bytes": 3043, "cache_tensor_bytes": null, "serialized_payload_bytes": 3043, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27333.36341707036, "ttft_ms": 13.867667061276734, "decode_ms": 124.35566692147404, "receiver_prefill_ms": 128.4382080193609}, "total_wall_ms": 27602.0553749986, "ttft_ms": 13.867667061276734, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,810,500", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2dd52fe72ca47aacd0e383e165bc8f70c1b82d5f1667eeca84e795e754cd28a2", "output_hash": "7810d312d2690f45bb13651b3c1cf9a2098b9e9d043463aaccc81157fad4a26e"} | ||||
| 1341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5acab6d391204f7ee37aeac0", "attempt_id": "66add46b2d5b", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:40.558043Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 30}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1250, "message_tokens": 1149, "message_utf8_bytes": 3043, "cache_tensor_bytes": null, "serialized_payload_bytes": 3043, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27333.36341707036, "ttft_ms": 13.429707963950932, "decode_ms": 80.71679202839732, "receiver_prefill_ms": 131.20533304754645}, "total_wall_ms": 27560.630958992988, "ttft_ms": 13.429707963950932, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quidra-11", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2dd52fe72ca47aacd0e383e165bc8f70c1b82d5f1667eeca84e795e754cd28a2", "output_hash": "41698c622e83fd669a8d097b3f00cb4197b0a66bac5aeca05b6224ada8b9dd5d"} | ||||
| 1342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e89174e6870d3d56a576221e", "attempt_id": "58ef165faa03", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:40.799961Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 30}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1243, "message_tokens": 1149, "message_utf8_bytes": 3043, "cache_tensor_bytes": null, "serialized_payload_bytes": 3043, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27333.36341707036, "ttft_ms": 13.370458036661148, "decode_ms": 80.1679160213098, "receiver_prefill_ms": 128.00354196224362}, "total_wall_ms": 27556.768625159748, "ttft_ms": 13.370458036661148, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "34,456", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2dd52fe72ca47aacd0e383e165bc8f70c1b82d5f1667eeca84e795e754cd28a2", "output_hash": "ef314acff148203832c5f9820b067bf033e6f1e9d61af2610137dcdc1928db40"} | ||||
| 1343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "837d5ef543bdc6ca6cbc0442", "attempt_id": "6c830d487917", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:41.037897Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 30}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1244, "message_tokens": 1149, "message_utf8_bytes": 3043, "cache_tensor_bytes": null, "serialized_payload_bytes": 3043, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27333.36341707036, "ttft_ms": 13.505125069059432, "decode_ms": 13.253499986603856, "receiver_prefill_ms": 128.2636660616845}, "total_wall_ms": 27490.23625010159, "ttft_ms": 13.505125069059432, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2dd52fe72ca47aacd0e383e165bc8f70c1b82d5f1667eeca84e795e754cd28a2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9ed54487c05fdf7bfe473ef8", "attempt_id": "57b924af334b", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:32:41.209438Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 30}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 1245, "message_tokens": 1149, "message_utf8_bytes": 3043, "cache_tensor_bytes": null, "serialized_payload_bytes": 3043, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27333.36341707036, "ttft_ms": 13.831417076289654, "decode_ms": 13.499249937012792, "receiver_prefill_ms": 157.6941660605371}, "total_wall_ms": 27520.314209046774, "ttft_ms": 13.831417076289654, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2dd52fe72ca47aacd0e383e165bc8f70c1b82d5f1667eeca84e795e754cd28a2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "115139347f8d40f7670a8074", "attempt_id": "3fe27ffecb80", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:08.802256Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2759, "message_tokens": 2671, "message_utf8_bytes": 6724, "cache_tensor_bytes": null, "serialized_payload_bytes": 6724, "side_information_bytes": 0, "fetched_bytes": 3489, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27390.31591603998, "ttft_ms": 13.56162503361702, "decode_ms": 93.48166605923325, "receiver_prefill_ms": 364.1218749107793}, "total_wall_ms": 27865.72549911216, "ttft_ms": 13.56162503361702, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b5c328c6703a9adfbc34cc218c493f431c3c478abcb603a5ea119677417ddf88", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | ||||
| 1346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "fb45f7affcd9a63d30a0cac2", "attempt_id": "0b7e587c24cc", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:09.293591Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2644, "message_tokens": 2552, "message_utf8_bytes": 6521, "cache_tensor_bytes": null, "serialized_payload_bytes": 6521, "side_information_bytes": 0, "fetched_bytes": 3301, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27390.31591603998, "ttft_ms": 13.389874948188663, "decode_ms": 13.765415991656482, "receiver_prefill_ms": 615.7390000298619}, "total_wall_ms": 28037.718499079347, "ttft_ms": 13.389874948188663, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "cb74f20e80d0aa082fc4ef07751031b8a87cc2aacc58ba4250b1f5e89f0f0f74", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8fa6be2d76944e07fe22b9a3", "attempt_id": "004ee6694d5f", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:09.955048Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2775, "message_tokens": 2676, "message_utf8_bytes": 6703, "cache_tensor_bytes": null, "serialized_payload_bytes": 6703, "side_information_bytes": 0, "fetched_bytes": 3462, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27390.31591603998, "ttft_ms": 13.666291953995824, "decode_ms": 94.9016670929268, "receiver_prefill_ms": 300.5081668961793}, "total_wall_ms": 27802.976541104726, "ttft_ms": 13.666291953995824, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6786800", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "d28ade61eca68ee15ba0bcf6521113abbb0eefa8a04b565841886f68071a5ce3", "output_hash": "33cee35795111ffd7720bcc954c699ed0ef5e51fe4ea1091cab2d69cd6de104f"} | ||||
| 1348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8e83ba299111c312d5348105", "attempt_id": "15600aff359c", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:10.382301Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2768, "message_tokens": 2678, "message_utf8_bytes": 6726, "cache_tensor_bytes": null, "serialized_payload_bytes": 6726, "side_information_bytes": 0, "fetched_bytes": 3489, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27390.31591603998, "ttft_ms": 13.705416000448167, "decode_ms": 94.56875000614673, "receiver_prefill_ms": 307.434624992311}, "total_wall_ms": 27809.710790985264, "ttft_ms": 13.705416000448167, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7510570", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e1bd2a56cdee5be7792048ab273af9d6b860cb45cf1eb874302c11802cfee1ed", "output_hash": "410d7d10eb5e18b187a54949b6517bffab264255a8ac37e64c7fa5b57e44d9ed"} | ||||
| 1349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5a32c2fefad51191c26dde0d", "attempt_id": "f0319ef0bdbe", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:10.816421Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2628, "message_tokens": 2528, "message_utf8_bytes": 6436, "cache_tensor_bytes": null, "serialized_payload_bytes": 6436, "side_information_bytes": 0, "fetched_bytes": 3234, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27390.31591603998, "ttft_ms": 13.97454203106463, "decode_ms": 81.86804200522602, "receiver_prefill_ms": 409.29108299314976}, "total_wall_ms": 27901.343708042987, "ttft_ms": 13.97454203106463, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quidra-11", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4664b719443ee0ecc861740dd7a05468b98d7932904c796b36181a3681a1a024", "output_hash": "41698c622e83fd669a8d097b3f00cb4197b0a66bac5aeca05b6224ada8b9dd5d"} | ||||
| 1350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ebef38725b83f9b48f2efb56", "attempt_id": "74803a156787", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:11.342875Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2771, "message_tokens": 2678, "message_utf8_bytes": 6726, "cache_tensor_bytes": null, "serialized_payload_bytes": 6726, "side_information_bytes": 0, "fetched_bytes": 3489, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27390.31591603998, "ttft_ms": 14.187792083248496, "decode_ms": 109.44312496576458, "receiver_prefill_ms": 322.9266250273213}, "total_wall_ms": 27840.555041097105, "ttft_ms": 14.187792083248496, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20874476", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6152b64b5f4890cc599dcfb0232a7956fb48a2664ac40285a52f8f28a99fe87a", "output_hash": "3c88c562589ff9497bc35cfa0f4576277d138f78b6a52230ba2be63f01495c47"} | ||||
| 1351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "61fc895a2b27f30d747e7dcc", "attempt_id": "6f6e33322e21", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:11.808053Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2661, "message_tokens": 2567, "message_utf8_bytes": 6590, "cache_tensor_bytes": null, "serialized_payload_bytes": 6590, "side_information_bytes": 0, "fetched_bytes": 3360, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27390.31591603998, "ttft_ms": 13.96333402954042, "decode_ms": 13.64699995610863, "receiver_prefill_ms": 319.23141691368073}, "total_wall_ms": 27740.73395796586, "ttft_ms": 13.96333402954042, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "05884cdf42dc217fcb72cba800a67716b54687b837beefbc489324a0dc36b2ff", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e1c7d226d258eff644160b41", "attempt_id": "09a243683193", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:12.173429Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 2704, "message_tokens": 2609, "message_utf8_bytes": 6616, "cache_tensor_bytes": null, "serialized_payload_bytes": 6616, "side_information_bytes": 0, "fetched_bytes": 3394, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27390.31591603998, "ttft_ms": 13.551958021707833, "decode_ms": 13.408583006821573, "receiver_prefill_ms": 488.02433302626014}, "total_wall_ms": 27908.864041091874, "ttft_ms": 13.551958021707833, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "282f5bb1dd56a7033596c23a867f38ea470228b132503d88c14f31b081658549", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "bf154d799af69b14ec9eda56", "attempt_id": "8e16fa8f0e39", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:15.098925Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 98942976}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 42, "message_tokens": null, "message_utf8_bytes": 9014, "cache_tensor_bytes": 98942976, "serialized_payload_bytes": 98942976, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 2391.9723329599947, "ttft_ms": 31.792583991773427, "decode_ms": 129.5679589966312, "receiver_prefill_ms": 0.0}, "total_wall_ms": 2561.197373899631, "ttft_ms": 31.792583991773427, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,810,500", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "7810d312d2690f45bb13651b3c1cf9a2098b9e9d043463aaccc81157fad4a26e"} | ||||
| 1354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3a048188bf832953535db146", "attempt_id": "d0d12550bd12", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:15.282700Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 98942976}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 46, "message_tokens": null, "message_utf8_bytes": 9014, "cache_tensor_bytes": 98942976, "serialized_payload_bytes": 98942976, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 2391.9723329599947, "ttft_ms": 50.02279102336615, "decode_ms": 142.32412492856383, "receiver_prefill_ms": 0.0}, "total_wall_ms": 2587.387957959436, "ttft_ms": 50.02279102336615, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-20T-7883", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "dd2e4bce724b0497351a41dbf71da774970bfcbe2553b73571a02bc7e8fa0e53"} | ||||
| 1355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b5a06d789f6c04b595055849", "attempt_id": "0dd07772880b", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:15.492688Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 98942976}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 53, "message_tokens": null, "message_utf8_bytes": 9014, "cache_tensor_bytes": 98942976, "serialized_payload_bytes": 98942976, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 2391.9723329599947, "ttft_ms": 45.61383300460875, "decode_ms": 99.45887490175664, "receiver_prefill_ms": 0.0}, "total_wall_ms": 2540.0656249839813, "ttft_ms": 45.61383300460875, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6786800", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "33cee35795111ffd7720bcc954c699ed0ef5e51fe4ea1091cab2d69cd6de104f"} | ||||
| 1356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d0a7c38db0e67b39395a1e3c", "attempt_id": "7aa9e89f0419", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:15.655240Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 98942976}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 9014, "cache_tensor_bytes": 98942976, "serialized_payload_bytes": 98942976, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 2391.9723329599947, "ttft_ms": 55.29454105999321, "decode_ms": 127.93062499258667, "receiver_prefill_ms": 0.0}, "total_wall_ms": 2577.6857079472393, "ttft_ms": 55.29454105999321, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,453,600", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "e6a2b25d3f99c6c8c339dc11738104244c59975cc325ebc53bc602e40b327216"} | ||||
| 1357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f808aacd731bcd786576c46e", "attempt_id": "e3897edef821", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:15.855136Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 98942976}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 54, "message_tokens": null, "message_utf8_bytes": 9014, "cache_tensor_bytes": 98942976, "serialized_payload_bytes": 98942976, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 2391.9723329599947, "ttft_ms": 30.208124895580113, "decode_ms": 84.92729195859283, "receiver_prefill_ms": 0.0}, "total_wall_ms": 2510.1319579407573, "ttft_ms": 30.208124895580113, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Draard-12", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c98ed1d4a10f5c2d70e15663c4ed0df74b420086785b671165017dfed27dee41"} | ||||
| 1358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a1bbc48f14740d0e4602d089", "attempt_id": "1afa8f9d0b43", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:15.987843Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 98942976}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 9014, "cache_tensor_bytes": 98942976, "serialized_payload_bytes": 98942976, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 2391.9723329599947, "ttft_ms": 30.716209090314806, "decode_ms": 142.4671249696985, "receiver_prefill_ms": 0.0}, "total_wall_ms": 2568.0527499644086, "ttft_ms": 30.716209090314806, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14,342,972", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "0fc7a451f2136364ca437a706951fe46718490fee7c0150579caa1c401451cc5"} | ||||
| 1359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "eca92e8010179b22bb261707", "attempt_id": "4e62717a3d94", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:16.178020Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 98942976}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 48, "message_tokens": null, "message_utf8_bytes": 9014, "cache_tensor_bytes": 98942976, "serialized_payload_bytes": 98942976, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 2391.9723329599947, "ttft_ms": 69.29412495810539, "decode_ms": 14.1245829872787, "receiver_prefill_ms": 0.0}, "total_wall_ms": 2477.791832992807, "ttft_ms": 69.29412495810539, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e4e5f0117f7980077ab3b0b8", "attempt_id": "b5c83a4f37b6", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:16.278136Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 98942976}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 9014, "cache_tensor_bytes": 98942976, "serialized_payload_bytes": 98942976, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 2391.9723329599947, "ttft_ms": 30.782249988988042, "decode_ms": 14.210249995812774, "receiver_prefill_ms": 0.0}, "total_wall_ms": 2439.6806659642607, "ttft_ms": 30.782249988988042, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Quilun-16", "bogus_amount": "8,495,020", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "195c757c397eb4a92c81b463", "attempt_id": "cb32a702154e", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:17.338638Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6282, "message_tokens": 6197, "message_utf8_bytes": 30751, "cache_tensor_bytes": null, "serialized_payload_bytes": 30751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03529200330376625, "ttft_ms": 14.566833968274295, "decode_ms": 124.82466700021178, "receiver_prefill_ms": 773.3494589338079}, "total_wall_ms": 924.3615000741556, "ttft_ms": 14.566833968274295, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,236,625", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6e71e6c5365db298b9144d66f0d893098a5ed3ab97d88cee8bbc2b5fd46de8fa", "output_hash": "5f724075674359492cf09f6cc38fa29d1d8d57b1cbe36c12f18a44145249093b"} | ||||
| 1362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f86e069fdcb8f94789513b90", "attempt_id": "7940a44af8f2", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:18.279434Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6285, "message_tokens": 6197, "message_utf8_bytes": 30751, "cache_tensor_bytes": null, "serialized_payload_bytes": 30751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03529200330376625, "ttft_ms": 13.964917045086622, "decode_ms": 137.56558403838426, "receiver_prefill_ms": 770.1070840703323}, "total_wall_ms": 931.5631260396913, "ttft_ms": 13.964917045086622, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CN-53T-4564", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6e71e6c5365db298b9144d66f0d893098a5ed3ab97d88cee8bbc2b5fd46de8fa", "output_hash": "63b72c2f0fa9c87c99863654eaed185c2db37aca56aeb2c04043723bedec7f95"} | ||||
| 1363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c00c55128d53f5ec6cc75bb0", "attempt_id": "869b2ab8dbf4", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:19.227766Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6292, "message_tokens": 6197, "message_utf8_bytes": 30751, "cache_tensor_bytes": null, "serialized_payload_bytes": 30751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03529200330376625, "ttft_ms": 13.927624910138547, "decode_ms": 96.57708392478526, "receiver_prefill_ms": 787.4500410398468}, "total_wall_ms": 907.6572089688852, "ttft_ms": 13.927624910138547, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7026040", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6e71e6c5365db298b9144d66f0d893098a5ed3ab97d88cee8bbc2b5fd46de8fa", "output_hash": "745005bc5caf64de51f389cd215c24264b3c2b8761c288554f09868d28ea3ca3"} | ||||
| 1364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "11f90642e22088d4e9a37522", "attempt_id": "6448c944137b", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:20.151806Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6283, "message_tokens": 6197, "message_utf8_bytes": 30751, "cache_tensor_bytes": null, "serialized_payload_bytes": 30751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03529200330376625, "ttft_ms": 13.976292102597654, "decode_ms": 123.87224996928126, "receiver_prefill_ms": 785.5084170587361}, "total_wall_ms": 932.863583904691, "ttft_ms": 13.976292102597654, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,824,670", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6e71e6c5365db298b9144d66f0d893098a5ed3ab97d88cee8bbc2b5fd46de8fa", "output_hash": "39851ef0b05834836a8abff080829144cd3d975d77f3c92cc6a0a87722460d9a"} | ||||
| 1365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4ddf773bd8fadef0d11b185d", "attempt_id": "72ba4cc6c311", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:21.101508Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6293, "message_tokens": 6197, "message_utf8_bytes": 30751, "cache_tensor_bytes": null, "serialized_payload_bytes": 30751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03529200330376625, "ttft_ms": 14.33687494136393, "decode_ms": 69.58745792508125, "receiver_prefill_ms": 782.0380410412326}, "total_wall_ms": 875.6143749924377, "ttft_ms": 14.33687494136393, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Urker-16", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6e71e6c5365db298b9144d66f0d893098a5ed3ab97d88cee8bbc2b5fd46de8fa", "output_hash": "13bcd50d62725e833c519fdb3eb450946e33fce2aca726f9c0f57cbe4cbcb2d9"} | ||||
| 1366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "7585759d1f2a8211def0e418", "attempt_id": "4a99b1c428e9", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:21.993843Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6286, "message_tokens": 6197, "message_utf8_bytes": 30751, "cache_tensor_bytes": null, "serialized_payload_bytes": 30751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03529200330376625, "ttft_ms": 13.875333010219038, "decode_ms": 138.56929203029722, "receiver_prefill_ms": 790.5014170100912}, "total_wall_ms": 952.6870419504121, "ttft_ms": 13.875333010219038, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20,882,147", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6e71e6c5365db298b9144d66f0d893098a5ed3ab97d88cee8bbc2b5fd46de8fa", "output_hash": "356b17197275dcee7c65db2fe000a00f20e9b375cc19defdddb60dd096101eab"} | ||||
| 1367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8b49097029d2688b9107a86e", "attempt_id": "db5d9509c519", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:22.963793Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6286, "message_tokens": 6197, "message_utf8_bytes": 30751, "cache_tensor_bytes": null, "serialized_payload_bytes": 30751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03529200330376625, "ttft_ms": 13.919458026066422, "decode_ms": 14.11487499717623, "receiver_prefill_ms": 781.3797920243815}, "total_wall_ms": 819.1698759328574, "ttft_ms": 13.919458026066422, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6e71e6c5365db298b9144d66f0d893098a5ed3ab97d88cee8bbc2b5fd46de8fa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "eff3b72bdc0eaa80b6c3d221", "attempt_id": "76d3ccd11381", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:23.800026Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6288, "message_tokens": 6197, "message_utf8_bytes": 30751, "cache_tensor_bytes": null, "serialized_payload_bytes": 30751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.03529200330376625, "ttft_ms": 14.074750011786819, "decode_ms": 14.070541015826166, "receiver_prefill_ms": 805.3054999327287}, "total_wall_ms": 843.2813750114292, "ttft_ms": 14.074750011786819, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6e71e6c5365db298b9144d66f0d893098a5ed3ab97d88cee8bbc2b5fd46de8fa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e482fe1bf4cbc40dd6c64c49", "attempt_id": "f86129725bf7", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:39.306993Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1122, "message_tokens": 1036, "message_utf8_bytes": 2652, "cache_tensor_bytes": null, "serialized_payload_bytes": 2652, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14646.676875068806, "ttft_ms": 13.619957957416773, "decode_ms": 94.66941701248288, "receiver_prefill_ms": 121.49412499275059}, "total_wall_ms": 14883.74925008975, "ttft_ms": 13.619957957416773, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5236625", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4b09a0c144966bbad4320908f48f320f64d6dff1f570edcaf7f18dbfc5132a04", "output_hash": "f0324cfa0e35a8d9bd4a75ef3f8cf62fcab822341c95b1d00f17b53fdf75ccf5"} | ||||
| 1370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3ecf4921bca527f4b3b1610c", "attempt_id": "55a9068115b2", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:39.561858Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1125, "message_tokens": 1036, "message_utf8_bytes": 2652, "cache_tensor_bytes": null, "serialized_payload_bytes": 2652, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14646.676875068806, "ttft_ms": 13.44216603320092, "decode_ms": 135.84958296269178, "receiver_prefill_ms": 121.03949999436736}, "total_wall_ms": 14918.862166116014, "ttft_ms": 13.44216603320092, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CN-53T-4564", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4b09a0c144966bbad4320908f48f320f64d6dff1f570edcaf7f18dbfc5132a04", "output_hash": "63b72c2f0fa9c87c99863654eaed185c2db37aca56aeb2c04043723bedec7f95"} | ||||
| 1371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0b0d278957464f0c99bfe905", "attempt_id": "1e6dc0b3b2ec", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:39.851693Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1132, "message_tokens": 1036, "message_utf8_bytes": 2652, "cache_tensor_bytes": null, "serialized_payload_bytes": 2652, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14646.676875068806, "ttft_ms": 13.620665995404124, "decode_ms": 95.00462491996586, "receiver_prefill_ms": 121.97562505025417}, "total_wall_ms": 14879.294709069654, "ttft_ms": 13.620665995404124, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7026040", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4b09a0c144966bbad4320908f48f320f64d6dff1f570edcaf7f18dbfc5132a04", "output_hash": "745005bc5caf64de51f389cd215c24264b3c2b8761c288554f09868d28ea3ca3"} | ||||
| 1372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "25f7cf62018972da49464b8e", "attempt_id": "28ff1200b9a5", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:40.101676Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1123, "message_tokens": 1036, "message_utf8_bytes": 2652, "cache_tensor_bytes": null, "serialized_payload_bytes": 2652, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14646.676875068806, "ttft_ms": 13.342624995857477, "decode_ms": 120.33591605722904, "receiver_prefill_ms": 121.00195896346122}, "total_wall_ms": 14903.166333097033, "ttft_ms": 13.342624995857477, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,187,820", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4b09a0c144966bbad4320908f48f320f64d6dff1f570edcaf7f18dbfc5132a04", "output_hash": "856804d5af6bf81ecc932fd68c47bd059046f4573ca64e21cb0c4c5d96dc59ca"} | ||||
| 1373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a16a256c3e46dca9e9d8dad5", "attempt_id": "40786d48c614", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:40.375152Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1133, "message_tokens": 1036, "message_utf8_bytes": 2652, "cache_tensor_bytes": null, "serialized_payload_bytes": 2652, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14646.676875068806, "ttft_ms": 13.853291980922222, "decode_ms": 66.88429194036871, "receiver_prefill_ms": 121.03204207960516}, "total_wall_ms": 14850.352042121813, "ttft_ms": 13.853291980922222, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Urker-16", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4b09a0c144966bbad4320908f48f320f64d6dff1f570edcaf7f18dbfc5132a04", "output_hash": "13bcd50d62725e833c519fdb3eb450946e33fce2aca726f9c0f57cbe4cbcb2d9"} | ||||
| 1374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e7c4a0cbc034e0a16721896f", "attempt_id": "01a741d77407", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:40.596002Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1126, "message_tokens": 1036, "message_utf8_bytes": 2652, "cache_tensor_bytes": null, "serialized_payload_bytes": 2652, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14646.676875068806, "ttft_ms": 13.264250010251999, "decode_ms": 134.02175006922334, "receiver_prefill_ms": 121.02229101583362}, "total_wall_ms": 14916.84162511956, "ttft_ms": 13.264250010251999, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21,265,704", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4b09a0c144966bbad4320908f48f320f64d6dff1f570edcaf7f18dbfc5132a04", "output_hash": "328730e89365ae840589e47ac26812af50340f1195419cdbf491ccd587a2eab5"} | ||||
| 1375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f10f8be51b4d2045653abc65", "attempt_id": "68368e08792e", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:40.883189Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1126, "message_tokens": 1036, "message_utf8_bytes": 2652, "cache_tensor_bytes": null, "serialized_payload_bytes": 2652, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14646.676875068806, "ttft_ms": 13.58512497972697, "decode_ms": 13.329374953173101, "receiver_prefill_ms": 121.03512499015778}, "total_wall_ms": 14796.446541091427, "ttft_ms": 13.58512497972697, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4b09a0c144966bbad4320908f48f320f64d6dff1f570edcaf7f18dbfc5132a04", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b6741e964b29e6caddf62339", "attempt_id": "aa569d13045e", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:41.049743Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1128, "message_tokens": 1036, "message_utf8_bytes": 2652, "cache_tensor_bytes": null, "serialized_payload_bytes": 2652, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14646.676875068806, "ttft_ms": 13.491875026375055, "decode_ms": 13.383207959122956, "receiver_prefill_ms": 121.07612495310605}, "total_wall_ms": 14796.496208989993, "ttft_ms": 13.491875026375055, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4b09a0c144966bbad4320908f48f320f64d6dff1f570edcaf7f18dbfc5132a04", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3a559c2bbf95cb30ade97a6d", "attempt_id": "65f989e6a54d", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:55.871482Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 17}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 766, "message_tokens": 676, "message_utf8_bytes": 1801, "cache_tensor_bytes": null, "serialized_payload_bytes": 1801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14654.734582989477, "ttft_ms": 14.097583014518023, "decode_ms": 121.62129196804017, "receiver_prefill_ms": 81.88412489835173}, "total_wall_ms": 14874.55825007055, "ttft_ms": 14.097583014518023, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,236,625", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9544785caee37c111d4ccdd3e42c0f29fab5a7e269ece52dd01f8ed68f8e4b43", "output_hash": "5f724075674359492cf09f6cc38fa29d1d8d57b1cbe36c12f18a44145249093b"} | ||||
| 1378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "fff3de4201f2abd447d105fe", "attempt_id": "fc36aef04381", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:56.112012Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 17}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 769, "message_tokens": 676, "message_utf8_bytes": 1801, "cache_tensor_bytes": null, "serialized_payload_bytes": 1801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14654.734582989477, "ttft_ms": 13.71258299332112, "decode_ms": 13.39779095724225, "receiver_prefill_ms": 78.58491700608283}, "total_wall_ms": 14761.902332887985, "ttft_ms": 13.71258299332112, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9544785caee37c111d4ccdd3e42c0f29fab5a7e269ece52dd01f8ed68f8e4b43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "681caab65502ccd12dc3ff21", "attempt_id": "487a6810e588", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:56.236176Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 17}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 776, "message_tokens": 676, "message_utf8_bytes": 1801, "cache_tensor_bytes": null, "serialized_payload_bytes": 1801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14654.734582989477, "ttft_ms": 13.510874938219786, "decode_ms": 93.41791598126292, "receiver_prefill_ms": 92.39491599146277}, "total_wall_ms": 14855.440167011693, "ttft_ms": 13.510874938219786, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8252854", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9544785caee37c111d4ccdd3e42c0f29fab5a7e269ece52dd01f8ed68f8e4b43", "output_hash": "0b172441eb5f315b0e90c34cabeb1d228dce23919fa88a7bb2734d342ff1b48e"} | ||||
| 1380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1c50f43976ef1d785a5cdabd", "attempt_id": "ab7e8d708055", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:56.453798Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 17}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 767, "message_tokens": 676, "message_utf8_bytes": 1801, "cache_tensor_bytes": null, "serialized_payload_bytes": 1801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14654.734582989477, "ttft_ms": 13.295584009028971, "decode_ms": 94.72499997355044, "receiver_prefill_ms": 81.62887499202043}, "total_wall_ms": 14845.768040977418, "ttft_ms": 13.295584009028971, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6929235", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9544785caee37c111d4ccdd3e42c0f29fab5a7e269ece52dd01f8ed68f8e4b43", "output_hash": "aae99ad47be986117fc352fa40a60c128f3f628966ca197ee1b83d1081f56970"} | ||||
| 1381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c341a6c49fdb21edb2dfafbd", "attempt_id": "e1ad0ce1f70b", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:56.662375Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 17}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 777, "message_tokens": 676, "message_utf8_bytes": 1801, "cache_tensor_bytes": null, "serialized_payload_bytes": 1801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14654.734582989477, "ttft_ms": 13.195708044804633, "decode_ms": 66.65245804470032, "receiver_prefill_ms": 91.83295804541558}, "total_wall_ms": 14827.782499953173, "ttft_ms": 13.195708044804633, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Urker-16", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9544785caee37c111d4ccdd3e42c0f29fab5a7e269ece52dd01f8ed68f8e4b43", "output_hash": "13bcd50d62725e833c519fdb3eb450946e33fce2aca726f9c0f57cbe4cbcb2d9"} | ||||
| 1382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8fcdd7cafe6ab37ff1d40721", "attempt_id": "e6204e34b8a2", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:56.852550Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 17}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 770, "message_tokens": 676, "message_utf8_bytes": 1801, "cache_tensor_bytes": null, "serialized_payload_bytes": 1801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14654.734582989477, "ttft_ms": 13.555125100538135, "decode_ms": 133.0276249209419, "receiver_prefill_ms": 90.84954194258898}, "total_wall_ms": 14893.59804103151, "ttft_ms": 13.555125100538135, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21,078,704", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9544785caee37c111d4ccdd3e42c0f29fab5a7e269ece52dd01f8ed68f8e4b43", "output_hash": "a2af1ef79d7b65c04f37afbc85d8da9676a07e54e60debe5305645ee5912191f"} | ||||
| 1383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "df1d357447ed5e5f7909842d", "attempt_id": "43bf75f9f537", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:57.108691Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 17}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 770, "message_tokens": 676, "message_utf8_bytes": 1801, "cache_tensor_bytes": null, "serialized_payload_bytes": 1801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14654.734582989477, "ttft_ms": 13.2884579943493, "decode_ms": 13.697791961021721, "receiver_prefill_ms": 90.24091600440443}, "total_wall_ms": 14773.334875004366, "ttft_ms": 13.2884579943493, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9544785caee37c111d4ccdd3e42c0f29fab5a7e269ece52dd01f8ed68f8e4b43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "acf073998ae9ee83c292f681", "attempt_id": "7a709b08748f", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:33:57.244551Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 17}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 772, "message_tokens": 676, "message_utf8_bytes": 1801, "cache_tensor_bytes": null, "serialized_payload_bytes": 1801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14654.734582989477, "ttft_ms": 13.44474998768419, "decode_ms": 13.141416013240814, "receiver_prefill_ms": 90.89054109063}, "total_wall_ms": 14773.615416022949, "ttft_ms": 13.44474998768419, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9544785caee37c111d4ccdd3e42c0f29fab5a7e269ece52dd01f8ed68f8e4b43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "dada5c8828b37ddb203c3362", "attempt_id": "53775dbabe7e", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:12.036349Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 790, "message_tokens": 701, "message_utf8_bytes": 1757, "cache_tensor_bytes": null, "serialized_payload_bytes": 1757, "side_information_bytes": 0, "fetched_bytes": 929, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14655.413042055443, "ttft_ms": 13.614041963592172, "decode_ms": 93.29129196703434, "receiver_prefill_ms": 92.18445792794228}, "total_wall_ms": 14858.881958993152, "ttft_ms": 13.614041963592172, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5236625", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "366cc92003006099d1b8b9223281ca2db73f81ff5b4f6c7c6b8fd927e3c18531", "output_hash": "f0324cfa0e35a8d9bd4a75ef3f8cf62fcab822341c95b1d00f17b53fdf75ccf5"} | ||||
| 1386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "60196e797f5ad41bc14f2a7f", "attempt_id": "92aaef7e2e5d", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:12.257624Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 738, "message_tokens": 646, "message_utf8_bytes": 1637, "cache_tensor_bytes": null, "serialized_payload_bytes": 1637, "side_information_bytes": 0, "fetched_bytes": 826, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14655.413042055443, "ttft_ms": 13.218333013355732, "decode_ms": 13.145708944648504, "receiver_prefill_ms": 81.08454197645187}, "total_wall_ms": 14764.273501001298, "ttft_ms": 13.218333013355732, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "6dab76262d47b0e892084d7932fee9ebc6710b1693be25d2d5a7fcedc7e408fd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c6daa96c3cdcc49fafd4442d", "attempt_id": "83eb6da68b0b", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:12.383318Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 787, "message_tokens": 688, "message_utf8_bytes": 1715, "cache_tensor_bytes": null, "serialized_payload_bytes": 1715, "side_information_bytes": 0, "fetched_bytes": 892, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14655.413042055443, "ttft_ms": 13.35245801601559, "decode_ms": 13.383499928750098, "receiver_prefill_ms": 91.95645805448294}, "total_wall_ms": 14775.595792103559, "ttft_ms": 13.35245801601559, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2a1bcd6dd7ebd79f8472f59bd051c9978b79f409cc83fb1dd32c35b96bda6e8c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f7ee7ffe21857216a14718e0", "attempt_id": "0d9716ba5e54", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:12.521124Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 736, "message_tokens": 646, "message_utf8_bytes": 1637, "cache_tensor_bytes": null, "serialized_payload_bytes": 1637, "side_information_bytes": 0, "fetched_bytes": 826, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14655.413042055443, "ttft_ms": 13.387083075940609, "decode_ms": 92.91187499184161, "receiver_prefill_ms": 79.47687502019107}, "total_wall_ms": 14842.623875010759, "ttft_ms": 13.387083075940609, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5187820", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "36e63f5c10e1cc7ea5796e91edf32a5c0e82fc13d3e5ad6d1ff7ae6be98361e7", "output_hash": "506e6115b34b564401e129c2ef42e2e7e0ec82b154b45d92c85846383969e6ed"} | ||||
| 1389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ac6cab49103603be11f8c72b", "attempt_id": "f84ec5795a4a", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:12.725940Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 773, "message_tokens": 673, "message_utf8_bytes": 1717, "cache_tensor_bytes": null, "serialized_payload_bytes": 1717, "side_information_bytes": 0, "fetched_bytes": 890, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14655.413042055443, "ttft_ms": 13.57708394061774, "decode_ms": 93.84529199451208, "receiver_prefill_ms": 90.84679197985679}, "total_wall_ms": 14855.115667101927, "ttft_ms": 13.57708394061774, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wentisoby-18", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ef6dc0f093d324bd5fec2def5091816957bc10f559c0317364759dd7dae06b81", "output_hash": "5e1b4376cbc7848ad56e533260fa5c8b3f9bbb233da09024ec193283565e0538"} | ||||
| 1390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "19276c72af0b83c0a1b7feb2", "attempt_id": "09833a3d75ee", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:12.942593Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 794, "message_tokens": 701, "message_utf8_bytes": 1757, "cache_tensor_bytes": null, "serialized_payload_bytes": 1757, "side_information_bytes": 0, "fetched_bytes": 929, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14655.413042055443, "ttft_ms": 13.43862502835691, "decode_ms": 134.01937508024275, "receiver_prefill_ms": 91.67170792352408}, "total_wall_ms": 14896.150959073566, "ttft_ms": 13.43862502835691, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14,017,885", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "366cc92003006099d1b8b9223281ca2db73f81ff5b4f6c7c6b8fd927e3c18531", "output_hash": "3aac6d7ef8ee4a890fd1ffbaeec7b2cc491e6791e284a6d1549cc189b5d6d07e"} | ||||
| 1391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d79559c0bbb7b55f88834349", "attempt_id": "aaa1c55c582c", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:13.200621Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 781, "message_tokens": 688, "message_utf8_bytes": 1715, "cache_tensor_bytes": null, "serialized_payload_bytes": 1715, "side_information_bytes": 0, "fetched_bytes": 892, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14655.413042055443, "ttft_ms": 13.283749925903976, "decode_ms": 13.18645803257823, "receiver_prefill_ms": 91.93645801860839}, "total_wall_ms": 14775.302042020485, "ttft_ms": 13.283749925903976, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2a1bcd6dd7ebd79f8472f59bd051c9978b79f409cc83fb1dd32c35b96bda6e8c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9fd80ed77ae99018aab204b7", "attempt_id": "2b1b4e57d69e", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:13.337997Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 783, "message_tokens": 688, "message_utf8_bytes": 1715, "cache_tensor_bytes": null, "serialized_payload_bytes": 1715, "side_information_bytes": 0, "fetched_bytes": 892, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14655.413042055443, "ttft_ms": 14.13133298046887, "decode_ms": 13.12083296943456, "receiver_prefill_ms": 92.93558297213167}, "total_wall_ms": 14777.036417042837, "ttft_ms": 14.13133298046887, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2a1bcd6dd7ebd79f8472f59bd051c9978b79f409cc83fb1dd32c35b96bda6e8c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4207e74a2f4b3ebb21063735", "attempt_id": "213f350615e4", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:14.196230Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 231321600}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 43, "message_tokens": null, "message_utf8_bytes": 30725, "cache_tensor_bytes": 231321600, "serialized_payload_bytes": 231321600, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 719.3774590268731, "ttft_ms": 53.951416979543865, "decode_ms": 106.7062079673633, "receiver_prefill_ms": 0.0}, "total_wall_ms": 889.353625010699, "ttft_ms": 53.951416979543865, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5236625", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "f0324cfa0e35a8d9bd4a75ef3f8cf62fcab822341c95b1d00f17b53fdf75ccf5"} | ||||
| 1394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e9032ad0d59f290c37ee7add", "attempt_id": "2031a02701ca", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:14.383238Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 231321600}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 46, "message_tokens": null, "message_utf8_bytes": 30725, "cache_tensor_bytes": 231321600, "serialized_payload_bytes": 231321600, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 719.3774590268731, "ttft_ms": 49.42712502088398, "decode_ms": 149.9504999956116, "receiver_prefill_ms": 0.0}, "total_wall_ms": 926.240042084828, "ttft_ms": 49.42712502088398, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CN-53T-4564", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "63b72c2f0fa9c87c99863654eaed185c2db37aca56aeb2c04043723bedec7f95"} | ||||
| 1395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f44c5e81d6a04f7f967c5911", "attempt_id": "ad3ff8d3ca52", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:14.608114Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 231321600}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 53, "message_tokens": null, "message_utf8_bytes": 30725, "cache_tensor_bytes": 231321600, "serialized_payload_bytes": 231321600, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 719.3774590268731, "ttft_ms": 46.42125009559095, "decode_ms": 104.94633298367262, "receiver_prefill_ms": 0.0}, "total_wall_ms": 878.5000429488719, "ttft_ms": 46.42125009559095, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7026040", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "745005bc5caf64de51f389cd215c24264b3c2b8761c288554f09868d28ea3ca3"} | ||||
| 1396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e3f98f2118402001cb1f35e1", "attempt_id": "5b18d92496a1", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:14.784311Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 231321600}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 30725, "cache_tensor_bytes": 231321600, "serialized_payload_bytes": 231321600, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 719.3774590268731, "ttft_ms": 47.992166015319526, "decode_ms": 105.60887504834682, "receiver_prefill_ms": 0.0}, "total_wall_ms": 880.6046260287985, "ttft_ms": 47.992166015319526, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5187820", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "506e6115b34b564401e129c2ef42e2e7e0ec82b154b45d92c85846383969e6ed"} | ||||
| 1397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2c442f9c364fa0ed9de3af7a", "attempt_id": "f66c005a13b0", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:14.962224Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 231321600}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 54, "message_tokens": null, "message_utf8_bytes": 30725, "cache_tensor_bytes": 231321600, "serialized_payload_bytes": 231321600, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 719.3774590268731, "ttft_ms": 49.77920895908028, "decode_ms": 105.19916692283005, "receiver_prefill_ms": 0.0}, "total_wall_ms": 881.7845840239897, "ttft_ms": 49.77920895908028, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wentisoby-18", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "5e1b4376cbc7848ad56e533260fa5c8b3f9bbb233da09024ec193283565e0538"} | ||||
| 1398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5e3a52c900710b296e62168a", "attempt_id": "a07a778cd051", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:15.142200Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 231321600}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30725, "cache_tensor_bytes": 231321600, "serialized_payload_bytes": 231321600, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 719.3774590268731, "ttft_ms": 47.02920909039676, "decode_ms": 120.07075001019984, "receiver_prefill_ms": 0.0}, "total_wall_ms": 894.1349590895697, "ttft_ms": 47.02920909039676, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "24084468", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "9cff8f9b32e3b9d064c4e2dfc1b66e78a731caaabf12e700bb3645c5725f9b6d"} | ||||
| 1399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e57b3fe7d6eaa8e288ab6a58", "attempt_id": "982a20849ca1", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:15.334100Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 231321600}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30725, "cache_tensor_bytes": 231321600, "serialized_payload_bytes": 231321600, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 719.3774590268731, "ttft_ms": 47.18604206573218, "decode_ms": 14.914250001311302, "receiver_prefill_ms": 0.0}, "total_wall_ms": 789.118001004681, "ttft_ms": 47.18604206573218, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b3112ff5e11a757bdf3c2104", "attempt_id": "143bb97d10b1", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:15.421171Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 231321600}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 30725, "cache_tensor_bytes": 231321600, "serialized_payload_bytes": 231321600, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 719.3774590268731, "ttft_ms": 46.21583304833621, "decode_ms": 14.879208989441395, "receiver_prefill_ms": 0.0}, "total_wall_ms": 788.1164590362459, "ttft_ms": 46.21583304833621, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9f4a53fb97b88f82b5bf4d90", "attempt_id": "22a5fdb7c664", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:15.507518Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6396, "message_tokens": 6311, "message_utf8_bytes": 31255, "cache_tensor_bytes": null, "serialized_payload_bytes": 31255, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026416033506393433, "ttft_ms": 13.842334039509296, "decode_ms": 98.42737508006394, "receiver_prefill_ms": 742.0234159799293}, "total_wall_ms": 867.1982489759102, "ttft_ms": 13.842334039509296, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5236625", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "deb638ddcef202b0a65018d3aa3f047f59ce22d9e9e2edab3549792e70b0d2e9", "output_hash": "f0324cfa0e35a8d9bd4a75ef3f8cf62fcab822341c95b1d00f17b53fdf75ccf5"} | ||||
| 1402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "01ac1ee08afe9a1a96c46b8f", "attempt_id": "42aae0ba707c", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:16.391273Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6399, "message_tokens": 6311, "message_utf8_bytes": 31255, "cache_tensor_bytes": null, "serialized_payload_bytes": 31255, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026416033506393433, "ttft_ms": 14.065707917325199, "decode_ms": 139.32808302342892, "receiver_prefill_ms": 749.9597080750391}, "total_wall_ms": 913.0894580157474, "ttft_ms": 14.065707917325199, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CN-53T-4564", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "deb638ddcef202b0a65018d3aa3f047f59ce22d9e9e2edab3549792e70b0d2e9", "output_hash": "63b72c2f0fa9c87c99863654eaed185c2db37aca56aeb2c04043723bedec7f95"} | ||||
| 1403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0500a1f56639e3d15becc936", "attempt_id": "9c2414822aa6", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:17.321687Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6406, "message_tokens": 6311, "message_utf8_bytes": 31255, "cache_tensor_bytes": null, "serialized_payload_bytes": 31255, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026416033506393433, "ttft_ms": 14.056374900974333, "decode_ms": 97.95545798260719, "receiver_prefill_ms": 773.3983750222251}, "total_wall_ms": 895.126624032855, "ttft_ms": 14.056374900974333, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7026040", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "deb638ddcef202b0a65018d3aa3f047f59ce22d9e9e2edab3549792e70b0d2e9", "output_hash": "745005bc5caf64de51f389cd215c24264b3c2b8761c288554f09868d28ea3ca3"} | ||||
| 1404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "881ebb5299f98bda55192b06", "attempt_id": "3310be822511", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:18.234005Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6397, "message_tokens": 6311, "message_utf8_bytes": 31255, "cache_tensor_bytes": null, "serialized_payload_bytes": 31255, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026416033506393433, "ttft_ms": 13.985792058520019, "decode_ms": 98.57400006148964, "receiver_prefill_ms": 770.3873330028728}, "total_wall_ms": 892.9402909707278, "ttft_ms": 13.985792058520019, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4824670", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "deb638ddcef202b0a65018d3aa3f047f59ce22d9e9e2edab3549792e70b0d2e9", "output_hash": "7d650cb178296568272fceaac0823be462a75f937d2aa9cd7e0fd6dc154adfb5"} | ||||
| 1405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6f9bd5b720b908b211a17a2d", "attempt_id": "80644c6d0c0e", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:19.144328Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6407, "message_tokens": 6311, "message_utf8_bytes": 31255, "cache_tensor_bytes": null, "serialized_payload_bytes": 31255, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026416033506393433, "ttft_ms": 14.005624921992421, "decode_ms": 69.0582919633016, "receiver_prefill_ms": 791.1937079625204}, "total_wall_ms": 884.3467910774052, "ttft_ms": 14.005624921992421, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Urker-16", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "deb638ddcef202b0a65018d3aa3f047f59ce22d9e9e2edab3549792e70b0d2e9", "output_hash": "13bcd50d62725e833c519fdb3eb450946e33fce2aca726f9c0f57cbe4cbcb2d9"} | ||||
| 1406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8bcceabb512dae91e978ee13", "attempt_id": "767e7c93d1bf", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:20.046088Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6400, "message_tokens": 6311, "message_utf8_bytes": 31255, "cache_tensor_bytes": null, "serialized_payload_bytes": 31255, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026416033506393433, "ttft_ms": 14.076124993152916, "decode_ms": 98.29187497962266, "receiver_prefill_ms": 783.9830829761922}, "total_wall_ms": 906.2285410473123, "ttft_ms": 14.076124993152916, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2108194", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "deb638ddcef202b0a65018d3aa3f047f59ce22d9e9e2edab3549792e70b0d2e9", "output_hash": "b164dfbc1313f2b24b036772a55a1784d2c1cacd0f06555131578a7017216de8"} | ||||
| 1407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5e40f7df7190d64b2dba8c3d", "attempt_id": "adbb00329794", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:20.969465Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6400, "message_tokens": 6311, "message_utf8_bytes": 31255, "cache_tensor_bytes": null, "serialized_payload_bytes": 31255, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026416033506393433, "ttft_ms": 14.023374998942018, "decode_ms": 15.310125076211989, "receiver_prefill_ms": 788.8275830773637}, "total_wall_ms": 828.0391240259632, "ttft_ms": 14.023374998942018, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "deb638ddcef202b0a65018d3aa3f047f59ce22d9e9e2edab3549792e70b0d2e9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ab6f4779a5f29442ae91005a", "attempt_id": "c4d7c322a3ef", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:21.814378Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 6402, "message_tokens": 6311, "message_utf8_bytes": 31255, "cache_tensor_bytes": null, "serialized_payload_bytes": 31255, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026416033506393433, "ttft_ms": 13.9586670557037, "decode_ms": 13.951750006526709, "receiver_prefill_ms": 817.8779169684276}, "total_wall_ms": 855.4572910070419, "ttft_ms": 13.9586670557037, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "deb638ddcef202b0a65018d3aa3f047f59ce22d9e9e2edab3549792e70b0d2e9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b4cd28e5ddaadd68119198c0", "attempt_id": "effe3d40daab", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:49.272276Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1918}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2031, "message_tokens": 1945, "message_utf8_bytes": 7028, "cache_tensor_bytes": null, "serialized_payload_bytes": 7028, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26584.533707937226, "ttft_ms": 13.674458023160696, "decode_ms": 94.1409170627594, "receiver_prefill_ms": 211.16850001271814}, "total_wall_ms": 26912.351207924075, "ttft_ms": 13.674458023160696, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5236625", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a50f81a2f8d61b175a223107514bcd3e47489f9629aa63ee53e3ef597f48676c", "output_hash": "f0324cfa0e35a8d9bd4a75ef3f8cf62fcab822341c95b1d00f17b53fdf75ccf5"} | ||||
| 1410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6c4267974cf670fb41f807f1", "attempt_id": "c081bc052ee3", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:49.620779Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1918}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2034, "message_tokens": 1945, "message_utf8_bytes": 7028, "cache_tensor_bytes": null, "serialized_payload_bytes": 7028, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26584.533707937226, "ttft_ms": 13.631707988679409, "decode_ms": 136.76766608841717, "receiver_prefill_ms": 211.83491603005677}, "total_wall_ms": 26950.05374995526, "ttft_ms": 13.631707988679409, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CN-53T-4564", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a50f81a2f8d61b175a223107514bcd3e47489f9629aa63ee53e3ef597f48676c", "output_hash": "63b72c2f0fa9c87c99863654eaed185c2db37aca56aeb2c04043723bedec7f95"} | ||||
| 1411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5196fe27a2b1d0a015c22415", "attempt_id": "23de4c1bee7a", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:50.003571Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1918}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2041, "message_tokens": 1945, "message_utf8_bytes": 7028, "cache_tensor_bytes": null, "serialized_payload_bytes": 7028, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26584.533707937226, "ttft_ms": 13.473458006046712, "decode_ms": 95.0988749973476, "receiver_prefill_ms": 212.26954204030335}, "total_wall_ms": 26908.625249983743, "ttft_ms": 13.473458006046712, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7026040", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a50f81a2f8d61b175a223107514bcd3e47489f9629aa63ee53e3ef597f48676c", "output_hash": "745005bc5caf64de51f389cd215c24264b3c2b8761c288554f09868d28ea3ca3"} | ||||
| 1412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "495a008cc883c5f3e9f5494c", "attempt_id": "73e8c75ce379", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:50.344976Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1918}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2032, "message_tokens": 1945, "message_utf8_bytes": 7028, "cache_tensor_bytes": null, "serialized_payload_bytes": 7028, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26584.533707937226, "ttft_ms": 13.581625069491565, "decode_ms": 120.79645798075944, "receiver_prefill_ms": 211.27512503881007}, "total_wall_ms": 26933.40287497267, "ttft_ms": 13.581625069491565, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,187,820", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a50f81a2f8d61b175a223107514bcd3e47489f9629aa63ee53e3ef597f48676c", "output_hash": "856804d5af6bf81ecc932fd68c47bd059046f4573ca64e21cb0c4c5d96dc59ca"} | ||||
| 1413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "302854827a7840cd87070863", "attempt_id": "855b371ddbbd", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:50.711600Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1918}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2042, "message_tokens": 1945, "message_utf8_bytes": 7028, "cache_tensor_bytes": null, "serialized_payload_bytes": 7028, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26584.533707937226, "ttft_ms": 13.53633392136544, "decode_ms": 68.31995793618262, "receiver_prefill_ms": 212.65508304350078}, "total_wall_ms": 26882.301790989004, "ttft_ms": 13.53633392136544, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Urker-16", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a50f81a2f8d61b175a223107514bcd3e47489f9629aa63ee53e3ef597f48676c", "output_hash": "13bcd50d62725e833c519fdb3eb450946e33fce2aca726f9c0f57cbe4cbcb2d9"} | ||||
| 1414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a2d663921c6d7382e5ee8855", "attempt_id": "cb34f516bf5e", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:51.026590Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1918}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2035, "message_tokens": 1945, "message_utf8_bytes": 7028, "cache_tensor_bytes": null, "serialized_payload_bytes": 7028, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26584.533707937226, "ttft_ms": 13.59320804476738, "decode_ms": 133.9391670189798, "receiver_prefill_ms": 211.96112490724772}, "total_wall_ms": 26947.249291930348, "ttft_ms": 13.59320804476738, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20,203,342", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a50f81a2f8d61b175a223107514bcd3e47489f9629aa63ee53e3ef597f48676c", "output_hash": "a44be814c77bb38454e9e08c373e74291169b956d647a0230fe13778d105b7e5"} | ||||
| 1415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4e798d7fd2551215a65e197e", "attempt_id": "4e20296e9a90", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:51.406706Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1918}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2035, "message_tokens": 1945, "message_utf8_bytes": 7028, "cache_tensor_bytes": null, "serialized_payload_bytes": 7028, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26584.533707937226, "ttft_ms": 13.448459096252918, "decode_ms": 13.630874920636415, "receiver_prefill_ms": 211.191458045505}, "total_wall_ms": 26825.981457950547, "ttft_ms": 13.448459096252918, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a50f81a2f8d61b175a223107514bcd3e47489f9629aa63ee53e3ef597f48676c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "464e43bbe8849f430d3581a0", "attempt_id": "d33d4014a28b", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:34:51.665639Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1918}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2037, "message_tokens": 1945, "message_utf8_bytes": 7028, "cache_tensor_bytes": null, "serialized_payload_bytes": 7028, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 26584.533707937226, "ttft_ms": 13.886458007618785, "decode_ms": 13.766709016636014, "receiver_prefill_ms": 219.90108292084187}, "total_wall_ms": 26835.42541693896, "ttft_ms": 13.886458007618785, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a50f81a2f8d61b175a223107514bcd3e47489f9629aa63ee53e3ef597f48676c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "45389cae005fb5b47bdf2a5d", "attempt_id": "3c58e708c1e6", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:20.145514Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1351, "message_tokens": 1261, "message_utf8_bytes": 3395, "cache_tensor_bytes": null, "serialized_payload_bytes": 3395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28211.461542057805, "ttft_ms": 13.765792013145983, "decode_ms": 122.56724992766976, "receiver_prefill_ms": 154.54591694287956}, "total_wall_ms": 28505.102584022097, "ttft_ms": 13.765792013145983, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,252,854", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a47d2d9e37e8b4359e1c296f914ab9bec64c3ebe6d0c0381d50b8e0b27f8f7e2", "output_hash": "9209da831fe61c3eb8d1a594ba822bc50ecd6afd78e837e992d96cc231d95e0c"} | ||||
| 1418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "774b610f675e7143c2331a85", "attempt_id": "adf71987f67c", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:20.457111Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1354, "message_tokens": 1261, "message_utf8_bytes": 3395, "cache_tensor_bytes": null, "serialized_payload_bytes": 3395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28211.461542057805, "ttft_ms": 13.672124943695962, "decode_ms": 136.35337504092604, "receiver_prefill_ms": 144.8562090517953}, "total_wall_ms": 28508.454584050924, "ttft_ms": 13.672124943695962, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CN-53T-4564", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a47d2d9e37e8b4359e1c296f914ab9bec64c3ebe6d0c0381d50b8e0b27f8f7e2", "output_hash": "63b72c2f0fa9c87c99863654eaed185c2db37aca56aeb2c04043723bedec7f95"} | ||||
| 1419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2bc63e9268f46fec4257af5c", "attempt_id": "4b983c29d8ac", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:20.771658Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1361, "message_tokens": 1261, "message_utf8_bytes": 3395, "cache_tensor_bytes": null, "serialized_payload_bytes": 3395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28211.461542057805, "ttft_ms": 14.183167018927634, "decode_ms": 97.51208301167935, "receiver_prefill_ms": 194.85087506473064}, "total_wall_ms": 28520.30579210259, "ttft_ms": 14.183167018927634, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8252854", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a47d2d9e37e8b4359e1c296f914ab9bec64c3ebe6d0c0381d50b8e0b27f8f7e2", "output_hash": "0b172441eb5f315b0e90c34cabeb1d228dce23919fa88a7bb2734d342ff1b48e"} | ||||
| 1420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "39031e0f4b5b9abcba3dffc3", "attempt_id": "0ffcf650293c", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:21.116233Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1352, "message_tokens": 1261, "message_utf8_bytes": 3395, "cache_tensor_bytes": null, "serialized_payload_bytes": 3395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28211.461542057805, "ttft_ms": 13.656415976583958, "decode_ms": 96.27470897976309, "receiver_prefill_ms": 144.79699998628348}, "total_wall_ms": 28468.42879196629, "ttft_ms": 13.656415976583958, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6069490", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a47d2d9e37e8b4359e1c296f914ab9bec64c3ebe6d0c0381d50b8e0b27f8f7e2", "output_hash": "4711441f1790872d27e09a73af4b4fe9b84256b0337928d055ea64ff622daa71"} | ||||
| 1421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c2c1109afbe4808b307c721e", "attempt_id": "ef3fd3665b5a", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:21.392273Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1362, "message_tokens": 1261, "message_utf8_bytes": 3395, "cache_tensor_bytes": null, "serialized_payload_bytes": 3395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28211.461542057805, "ttft_ms": 13.831958058290184, "decode_ms": 69.74966591224074, "receiver_prefill_ms": 150.79145901836455}, "total_wall_ms": 28447.959584067576, "ttft_ms": 13.831958058290184, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Urker-16", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a47d2d9e37e8b4359e1c296f914ab9bec64c3ebe6d0c0381d50b8e0b27f8f7e2", "output_hash": "13bcd50d62725e833c519fdb3eb450946e33fce2aca726f9c0f57cbe4cbcb2d9"} | ||||
| 1422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2599e29ca71bfaaa2f378337", "attempt_id": "f47a66099183", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:21.646798Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1355, "message_tokens": 1261, "message_utf8_bytes": 3395, "cache_tensor_bytes": null, "serialized_payload_bytes": 3395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28211.461542057805, "ttft_ms": 13.70508293621242, "decode_ms": 136.20358298067003, "receiver_prefill_ms": 184.32254192885011}, "total_wall_ms": 28547.926958068274, "ttft_ms": 13.70508293621242, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13,488,479", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a47d2d9e37e8b4359e1c296f914ab9bec64c3ebe6d0c0381d50b8e0b27f8f7e2", "output_hash": "6c6c60c4d336c7a8785c178f346d67b43a4c9b96a48c843bd7cd11784f64223e"} | ||||
| 1423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "14a3ad67ce4556d1cfb8c7b4", "attempt_id": "e73a495ceb08", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:22.001228Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1355, "message_tokens": 1261, "message_utf8_bytes": 3395, "cache_tensor_bytes": null, "serialized_payload_bytes": 3395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28211.461542057805, "ttft_ms": 13.725124998018146, "decode_ms": 13.815375044941902, "receiver_prefill_ms": 144.33587493840605}, "total_wall_ms": 28385.604542098008, "ttft_ms": 13.725124998018146, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a47d2d9e37e8b4359e1c296f914ab9bec64c3ebe6d0c0381d50b8e0b27f8f7e2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c50de12766ab77c341b156a9", "attempt_id": "31563b2fcbb6", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:22.193357Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 32}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1357, "message_tokens": 1261, "message_utf8_bytes": 3395, "cache_tensor_bytes": null, "serialized_payload_bytes": 3395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28211.461542057805, "ttft_ms": 13.62950005568564, "decode_ms": 13.653457979671657, "receiver_prefill_ms": 177.26633290294558}, "total_wall_ms": 28418.166292016394, "ttft_ms": 13.62950005568564, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a47d2d9e37e8b4359e1c296f914ab9bec64c3ebe6d0c0381d50b8e0b27f8f7e2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "cefca2be28e706dbc3f3ab03", "attempt_id": "e4f8fe0259da", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:50.679151Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2070, "message_tokens": 1981, "message_utf8_bytes": 5176, "cache_tensor_bytes": null, "serialized_payload_bytes": 5176, "side_information_bytes": 0, "fetched_bytes": 2593, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28260.889666969888, "ttft_ms": 13.519415981136262, "decode_ms": 96.59266599919647, "receiver_prefill_ms": 258.26116697862744}, "total_wall_ms": 28633.5017089732, "ttft_ms": 13.519415981136262, "input_usage": {"lookups": 9}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5236625", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "391110c477ecdfeafcdd5d5a16a124350470939f2762642d53e712d06c002690", "output_hash": "f0324cfa0e35a8d9bd4a75ef3f8cf62fcab822341c95b1d00f17b53fdf75ccf5"} | ||||
| 1426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e97c22bdfca6cae9b944842e", "attempt_id": "32b4665da4f0", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:51.069944Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 1937, "message_tokens": 1845, "message_utf8_bytes": 4896, "cache_tensor_bytes": null, "serialized_payload_bytes": 4896, "side_information_bytes": 0, "fetched_bytes": 2319, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28260.889666969888, "ttft_ms": 13.52625002618879, "decode_ms": 136.5687500219792, "receiver_prefill_ms": 205.8276670286432}, "total_wall_ms": 28620.994333992712, "ttft_ms": 13.52625002618879, "input_usage": {"lookups": 9}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CN-53T-4564", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a1dba3598ea5ad5c2aa8e87229fc5abad0104e2bd5f6531dea9f98a2d6c983cf", "output_hash": "63b72c2f0fa9c87c99863654eaed185c2db37aca56aeb2c04043723bedec7f95"} | ||||
| 1427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "81f13aa3d23ee1559b878670", "attempt_id": "f53e6558a90a", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:51.448336Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2055, "message_tokens": 1956, "message_utf8_bytes": 5155, "cache_tensor_bytes": null, "serialized_payload_bytes": 5155, "side_information_bytes": 0, "fetched_bytes": 2558, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28260.889666969888, "ttft_ms": 13.445000047795475, "decode_ms": 13.500249944627285, "receiver_prefill_ms": 236.4125830354169}, "total_wall_ms": 28528.405708028004, "ttft_ms": 13.445000047795475, "input_usage": {"lookups": 9}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "d9f355034a4919b2ee63a2a6326aa36389eb4679525102e7afa500e0a0b642c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b6e36a040f319e262697019c", "attempt_id": "9a63ff3e7f6a", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:51.734949Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2014, "message_tokens": 1924, "message_utf8_bytes": 5081, "cache_tensor_bytes": null, "serialized_payload_bytes": 5081, "side_information_bytes": 0, "fetched_bytes": 2497, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28260.889666969888, "ttft_ms": 14.15095804259181, "decode_ms": 99.11412501242012, "receiver_prefill_ms": 318.8807499827817}, "total_wall_ms": 28695.990333915688, "ttft_ms": 14.15095804259181, "input_usage": {"lookups": 9}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5187820", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3fe6371c6f66cd410891142d0caa565eb5f29914d319b00cc534e73498484005", "output_hash": "506e6115b34b564401e129c2ef42e2e7e0ec82b154b45d92c85846383969e6ed"} | ||||
| 1429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "30f41685451fb6668715f53a", "attempt_id": "690247df5fe2", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:52.188239Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2001, "message_tokens": 1901, "message_utf8_bytes": 5043, "cache_tensor_bytes": null, "serialized_payload_bytes": 5043, "side_information_bytes": 0, "fetched_bytes": 2467, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28260.889666969888, "ttft_ms": 13.637749943882227, "decode_ms": 67.8624160354957, "receiver_prefill_ms": 210.2904999628663}, "total_wall_ms": 28558.95545904059, "ttft_ms": 13.637749943882227, "input_usage": {"lookups": 9}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Urker-16", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2d5b2bac54794fd20dbd44ef3a3e7c85045b6118ddda8d5e5b1884f61d8a8cb1", "output_hash": "13bcd50d62725e833c519fdb3eb450946e33fce2aca726f9c0f57cbe4cbcb2d9"} | ||||
| 1430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a067a602494a4009277e67f6", "attempt_id": "e76bb1c04b5f", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:52.505947Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2049, "message_tokens": 1956, "message_utf8_bytes": 5155, "cache_tensor_bytes": null, "serialized_payload_bytes": 5155, "side_information_bytes": 0, "fetched_bytes": 2558, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28260.889666969888, "ttft_ms": 14.416625024750829, "decode_ms": 110.2638749871403, "receiver_prefill_ms": 211.05158398859203}, "total_wall_ms": 28599.7276250273, "ttft_ms": 14.416625024750829, "input_usage": {"lookups": 9}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14936855", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a9db72e148cbf9b5a96088fce4db88970b61c13aa21dc1be7fa74f9cf7adc24d", "output_hash": "c8d3235581060a2a3a6817385b337f6e5171e918972dd95b6188b095a1b4c66f"} | ||||
| 1431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "90ace0e0eb83ae351e2a0f37", "attempt_id": "7e9a6a4b4668", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:52.863082Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2015, "message_tokens": 1922, "message_utf8_bytes": 5090, "cache_tensor_bytes": null, "serialized_payload_bytes": 5090, "side_information_bytes": 0, "fetched_bytes": 2483, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28260.889666969888, "ttft_ms": 13.526208000257611, "decode_ms": 13.901083031669259, "receiver_prefill_ms": 218.87316601350904}, "total_wall_ms": 28510.188166983426, "ttft_ms": 13.526208000257611, "input_usage": {"lookups": 9}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "2542059506fb6e861bc185d1bc6e75874176fb6b21aea27149a6851d88a51e05", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "32723b898d953cad3c3bd983", "attempt_id": "0443c0183b65", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:53.130226Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 2051, "message_tokens": 1956, "message_utf8_bytes": 5155, "cache_tensor_bytes": null, "serialized_payload_bytes": 5155, "side_information_bytes": 0, "fetched_bytes": 2558, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 28260.889666969888, "ttft_ms": 13.819165993481874, "decode_ms": 13.771416968666017, "receiver_prefill_ms": 245.8000419428572}, "total_wall_ms": 28537.10575099103, "ttft_ms": 13.819165993481874, "input_usage": {"lookups": 9}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "d9f355034a4919b2ee63a2a6326aa36389eb4679525102e7afa500e0a0b642c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "80917d22fd23ef2d58ba9046", "attempt_id": "03211af3bc59", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:54.532270Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 238399488}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 43, "message_tokens": null, "message_utf8_bytes": 31201, "cache_tensor_bytes": 238399488, "serialized_payload_bytes": 238399488, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1107.888541999273, "ttft_ms": 51.34804197587073, "decode_ms": 144.98691691551358, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1330.8715421007946, "ttft_ms": 51.34804197587073, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,236,625", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "5f724075674359492cf09f6cc38fa29d1d8d57b1cbe36c12f18a44145249093b"} | ||||
| 1434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ff6c4320ba71242276b2c170", "attempt_id": "41e00c0c523a", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:54.774512Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 238399488}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 46, "message_tokens": null, "message_utf8_bytes": 31201, "cache_tensor_bytes": 238399488, "serialized_payload_bytes": 238399488, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1107.888541999273, "ttft_ms": 115.91662501450628, "decode_ms": 152.79374993406236, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1380.9211670886725, "ttft_ms": 115.91662501450628, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CN-53T-4564", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "63b72c2f0fa9c87c99863654eaed185c2db37aca56aeb2c04043723bedec7f95"} | ||||
| 1435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "bac161ad34ac8ffe100db2cf", "attempt_id": "e4b76d646d61", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:55.066062Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 238399488}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 53, "message_tokens": null, "message_utf8_bytes": 31201, "cache_tensor_bytes": 238399488, "serialized_payload_bytes": 238399488, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1107.888541999273, "ttft_ms": 137.10904109757394, "decode_ms": 106.36366705875844, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1355.7005421025679, "ttft_ms": 137.10904109757394, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7026040", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "745005bc5caf64de51f389cd215c24264b3c2b8761c288554f09868d28ea3ca3"} | ||||
| 1436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f5952c08d2b5b6fd0a1c7e94", "attempt_id": "7c5970b0fc2a", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:55.332330Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 238399488}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 31201, "cache_tensor_bytes": 238399488, "serialized_payload_bytes": 238399488, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1107.888541999273, "ttft_ms": 108.21304202545434, "decode_ms": 136.78520801477134, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1357.512708986178, "ttft_ms": 108.21304202545434, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,187,820", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "856804d5af6bf81ecc932fd68c47bd059046f4573ca64e21cb0c4c5d96dc59ca"} | ||||
| 1437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5dd45c293a712bb722eccafa", "attempt_id": "77d38c1139a1", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:55.599373Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 238399488}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 54, "message_tokens": null, "message_utf8_bytes": 31201, "cache_tensor_bytes": 238399488, "serialized_payload_bytes": 238399488, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1107.888541999273, "ttft_ms": 83.12412502709776, "decode_ms": 75.63141593709588, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1271.2796250125393, "ttft_ms": 83.12412502709776, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Urker-16", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "13bcd50d62725e833c519fdb3eb450946e33fce2aca726f9c0f57cbe4cbcb2d9"} | ||||
| 1438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "950d4a43d5b63381db725688", "attempt_id": "022c544fe97a", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:55.780625Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 238399488}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 31201, "cache_tensor_bytes": 238399488, "serialized_payload_bytes": 238399488, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1107.888541999273, "ttft_ms": 48.36150002665818, "decode_ms": 121.27233296632767, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1282.0797079475597, "ttft_ms": 48.36150002665818, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14213474", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "f66bfab08b868e35eea7b6d0e4f26c213c8255b6b13bef10cf210555ca814b1c"} | ||||
| 1439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2f54baeafc8f993ec98d3688", "attempt_id": "bd33236c9e06", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:55.972759Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 238399488}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 31201, "cache_tensor_bytes": 238399488, "serialized_payload_bytes": 238399488, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1107.888541999273, "ttft_ms": 48.36987506132573, "decode_ms": 15.249124960973859, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1175.6681670667604, "ttft_ms": 48.36987506132573, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d49dad26792e0abab04f1120", "attempt_id": "80724acd095d", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:56.058112Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 238399488}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5836, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 31201, "cache_tensor_bytes": 238399488, "serialized_payload_bytes": 238399488, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 1107.888541999273, "ttft_ms": 47.45991597883403, "decode_ms": 15.515959006734192, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1175.4940008977428, "ttft_ms": 47.45991597883403, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Lunfel-18", "bogus_amount": "4,824,670", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "bc36bab5d59e6a2e990c66e5", "attempt_id": "3aa00ef117f4", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:57.096174Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2407, "message_tokens": 2318, "message_utf8_bytes": 8288, "cache_tensor_bytes": null, "serialized_payload_bytes": 8288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.033791991882026196, "ttft_ms": 13.843958033248782, "decode_ms": 96.99337498750538, "receiver_prefill_ms": 274.68375000171363}, "total_wall_ms": 391.58325106836855, "ttft_ms": 13.843958033248782, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "535,300", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "aa26eae05d558fd6e4c11a7079dbe3efe6574efb099211284d7f465a5c3027aa", "output_hash": "310282bc8b1d285db5e2b900f31e17e95e68f26b55e4eb87ed8d54f74105024b"} | ||||
| 1442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "793c7cf00dca25462bfe13c2", "attempt_id": "6a9b99598b23", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:57.501325Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2404, "message_tokens": 2318, "message_utf8_bytes": 8288, "cache_tensor_bytes": null, "serialized_payload_bytes": 8288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.033791991882026196, "ttft_ms": 13.730334001593292, "decode_ms": 135.3455410571769, "receiver_prefill_ms": 262.61141698341817}, "total_wall_ms": 415.3032510075718, "ttft_ms": 13.730334001593292, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DB-72P-3503", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "aa26eae05d558fd6e4c11a7079dbe3efe6574efb099211284d7f465a5c3027aa", "output_hash": "051acaf42a5b0e2760fcb6fb7252c81cae4688e78f4f2cfa24c17e2daf75b9e3"} | ||||
| 1443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "37fda717b132068a0ac26b20", "attempt_id": "27b90baba243", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:57.930576Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2411, "message_tokens": 2318, "message_utf8_bytes": 8288, "cache_tensor_bytes": null, "serialized_payload_bytes": 8288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.033791991882026196, "ttft_ms": 13.621708028949797, "decode_ms": 95.34083295147866, "receiver_prefill_ms": 263.4287910768762}, "total_wall_ms": 376.0849590180442, "ttft_ms": 13.621708028949797, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "aa26eae05d558fd6e4c11a7079dbe3efe6574efb099211284d7f465a5c3027aa", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 1444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8bf3b2638ea207f74275fa64", "attempt_id": "cc73ecd9d01c", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:58.320496Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2404, "message_tokens": 2318, "message_utf8_bytes": 8288, "cache_tensor_bytes": null, "serialized_payload_bytes": 8288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.033791991882026196, "ttft_ms": 13.734625070355833, "decode_ms": 122.26495903450996, "receiver_prefill_ms": 263.12816701829433}, "total_wall_ms": 402.7411669958383, "ttft_ms": 13.734625070355833, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,632,215", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "aa26eae05d558fd6e4c11a7079dbe3efe6574efb099211284d7f465a5c3027aa", "output_hash": "eda75ec7ef30171e592506abc3e5b148b641b914854fc239672772c94e5c3232"} | ||||
| 1445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f9e09c202826803ea840fc91", "attempt_id": "78bc89a3e947", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:58.737209Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2414, "message_tokens": 2318, "message_utf8_bytes": 8288, "cache_tensor_bytes": null, "serialized_payload_bytes": 8288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.033791991882026196, "ttft_ms": 13.50137498229742, "decode_ms": 95.38145805709064, "receiver_prefill_ms": 263.3870409335941}, "total_wall_ms": 375.90137496590614, "ttft_ms": 13.50137498229742, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "aa26eae05d558fd6e4c11a7079dbe3efe6574efb099211284d7f465a5c3027aa", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 1446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2e04d7fc68c9a1411acd4d07", "attempt_id": "9a8a0cc4b84b", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:59.126973Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2407, "message_tokens": 2318, "message_utf8_bytes": 8288, "cache_tensor_bytes": null, "serialized_payload_bytes": 8288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.033791991882026196, "ttft_ms": 13.621708028949797, "decode_ms": 94.62620900012553, "receiver_prefill_ms": 263.62941693514585}, "total_wall_ms": 375.56279194541276, "ttft_ms": 13.621708028949797, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2516345", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "aa26eae05d558fd6e4c11a7079dbe3efe6574efb099211284d7f465a5c3027aa", "output_hash": "c9746d6b321a85e7860df5d1300d2968d4ee3af4bbfa9b3c78c9484900e77381"} | ||||
| 1447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4fc8e6ff48051f154aaa1751", "attempt_id": "f8843076f5ff", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:59.516399Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2407, "message_tokens": 2318, "message_utf8_bytes": 8288, "cache_tensor_bytes": null, "serialized_payload_bytes": 8288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.033791991882026196, "ttft_ms": 13.392583001405, "decode_ms": 13.639791985042393, "receiver_prefill_ms": 262.9818330751732}, "total_wall_ms": 293.57912589330226, "ttft_ms": 13.392583001405, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "aa26eae05d558fd6e4c11a7079dbe3efe6574efb099211284d7f465a5c3027aa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "7ba617bbaad3f5a63a941dd5", "attempt_id": "a80d04f906cb", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:35:59.824590Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2409, "message_tokens": 2318, "message_utf8_bytes": 8288, "cache_tensor_bytes": null, "serialized_payload_bytes": 8288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.033791991882026196, "ttft_ms": 13.725041993893683, "decode_ms": 13.780791079625487, "receiver_prefill_ms": 264.4435829715803}, "total_wall_ms": 295.5767089733854, "ttft_ms": 13.725041993893683, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "aa26eae05d558fd6e4c11a7079dbe3efe6574efb099211284d7f465a5c3027aa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "28e069a34d07ff24535d2afc", "attempt_id": "18f0ceb9b1c7", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:14.218349Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1127, "message_tokens": 1036, "message_utf8_bytes": 2369, "cache_tensor_bytes": null, "serialized_payload_bytes": 2369, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14084.534749970771, "ttft_ms": 13.7305409880355, "decode_ms": 94.44662497844547, "receiver_prefill_ms": 121.7910829000175}, "total_wall_ms": 14316.346333012916, "ttft_ms": 13.7305409880355, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "535,300", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c5638ab9853837d89a445e697804f09f6a3d0cf6c2a0fb955da5b8d8010c988f", "output_hash": "310282bc8b1d285db5e2b900f31e17e95e68f26b55e4eb87ed8d54f74105024b"} | ||||
| 1450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "628e7ff7bbd8f13f13995e0f", "attempt_id": "107c3df6f4c0", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:14.464284Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1124, "message_tokens": 1036, "message_utf8_bytes": 2369, "cache_tensor_bytes": null, "serialized_payload_bytes": 2369, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14084.534749970771, "ttft_ms": 13.400291092693806, "decode_ms": 135.31916600186378, "receiver_prefill_ms": 120.95191597472876}, "total_wall_ms": 14356.111874920316, "ttft_ms": 13.400291092693806, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DB-72P-3503", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c5638ab9853837d89a445e697804f09f6a3d0cf6c2a0fb955da5b8d8010c988f", "output_hash": "051acaf42a5b0e2760fcb6fb7252c81cae4688e78f4f2cfa24c17e2daf75b9e3"} | ||||
| 1451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b209ab8db43e690c3b6c5f22", "attempt_id": "4cffe31ff6e2", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:14.749902Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1131, "message_tokens": 1036, "message_utf8_bytes": 2369, "cache_tensor_bytes": null, "serialized_payload_bytes": 2369, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14084.534749970771, "ttft_ms": 13.88458302244544, "decode_ms": 94.98499997425824, "receiver_prefill_ms": 121.31541699636728}, "total_wall_ms": 14316.582540981472, "ttft_ms": 13.88458302244544, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c5638ab9853837d89a445e697804f09f6a3d0cf6c2a0fb955da5b8d8010c988f", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 1452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a9455032c10aa4d84f764bc2", "attempt_id": "5fbf28bda231", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:14.996035Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1124, "message_tokens": 1036, "message_utf8_bytes": 2369, "cache_tensor_bytes": null, "serialized_payload_bytes": 2369, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14084.534749970771, "ttft_ms": 13.530290918424726, "decode_ms": 122.91462498251349, "receiver_prefill_ms": 122.15995800215751}, "total_wall_ms": 14345.030582975596, "ttft_ms": 13.530290918424726, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c5638ab9853837d89a445e697804f09f6a3d0cf6c2a0fb955da5b8d8010c988f", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 1453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "806e2b0b05c9792f96b0a70f", "attempt_id": "72f4720c3742", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:15.272032Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1134, "message_tokens": 1036, "message_utf8_bytes": 2369, "cache_tensor_bytes": null, "serialized_payload_bytes": 2369, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14084.534749970771, "ttft_ms": 13.966791098937392, "decode_ms": 68.20216693449765, "receiver_prefill_ms": 123.67983302101493}, "total_wall_ms": 14295.083042001352, "ttft_ms": 13.966791098937392, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Novost-15", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c5638ab9853837d89a445e697804f09f6a3d0cf6c2a0fb955da5b8d8010c988f", "output_hash": "851a475fb1ba6ddb5b9988bd32045e7b0c809becb5edebc929cce56a70ed5a5d"} | ||||
| 1454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6dbe8579ecc50c7cf5fddeaf", "attempt_id": "c93a1c749d87", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:15.496849Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1127, "message_tokens": 1036, "message_utf8_bytes": 2369, "cache_tensor_bytes": null, "serialized_payload_bytes": 2369, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14084.534749970771, "ttft_ms": 13.531415956094861, "decode_ms": 110.03220803104341, "receiver_prefill_ms": 121.71845801640302}, "total_wall_ms": 14331.66349993553, "ttft_ms": 13.531415956094861, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15173162", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c5638ab9853837d89a445e697804f09f6a3d0cf6c2a0fb955da5b8d8010c988f", "output_hash": "cc03b0e0d18e28d4b86c050a4e72102728582e4c3eddce83767093d208d86863"} | ||||
| 1455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "09d0fc90ae2d9f4b69117c11", "attempt_id": "cc3a0e876434", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:15.758381Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1127, "message_tokens": 1036, "message_utf8_bytes": 2369, "cache_tensor_bytes": null, "serialized_payload_bytes": 2369, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14084.534749970771, "ttft_ms": 13.2902089972049, "decode_ms": 13.595665921457112, "receiver_prefill_ms": 121.89254094846547}, "total_wall_ms": 14235.049540991895, "ttft_ms": 13.2902089972049, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c5638ab9853837d89a445e697804f09f6a3d0cf6c2a0fb955da5b8d8010c988f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "549fd0e7043a4b6b89e097c9", "attempt_id": "2a6f64a665d5", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:15.923222Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1129, "message_tokens": 1036, "message_utf8_bytes": 2369, "cache_tensor_bytes": null, "serialized_payload_bytes": 2369, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14084.534749970771, "ttft_ms": 13.373833964578807, "decode_ms": 13.39112501591444, "receiver_prefill_ms": 120.9158330457285}, "total_wall_ms": 14234.04383403249, "ttft_ms": 13.373833964578807, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c5638ab9853837d89a445e697804f09f6a3d0cf6c2a0fb955da5b8d8010c988f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "89b632f0e6de81c95ea0c962", "attempt_id": "3fb87ff1f110", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:30.196956Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 14}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 641, "message_tokens": 547, "message_utf8_bytes": 1433, "cache_tensor_bytes": null, "serialized_payload_bytes": 1433, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14110.15425005462, "ttft_ms": 13.454999891109765, "decode_ms": 13.339249999262393, "receiver_prefill_ms": 72.18979101162404}, "total_wall_ms": 14215.450625051744, "ttft_ms": 13.454999891109765, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "26e8142bbe991631989d1ca5c21214dedae6fd0f796dae52a765cde97c9deae5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b86e4e04a0f5eec08cba29d7", "attempt_id": "ae338b2ec1ae", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:30.316294Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 14}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 638, "message_tokens": 547, "message_utf8_bytes": 1433, "cache_tensor_bytes": null, "serialized_payload_bytes": 1433, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14110.15425005462, "ttft_ms": 13.252333970740438, "decode_ms": 133.0637080827728, "receiver_prefill_ms": 73.46387498546392}, "total_wall_ms": 14331.303874962032, "ttft_ms": 13.252333970740438, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "26e8142bbe991631989d1ca5c21214dedae6fd0f796dae52a765cde97c9deae5", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 1459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "692e7b9f9202efa07afc77f4", "attempt_id": "89fa9d45600e", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:30.551484Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 14}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 645, "message_tokens": 547, "message_utf8_bytes": 1433, "cache_tensor_bytes": null, "serialized_payload_bytes": 1433, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14110.15425005462, "ttft_ms": 13.430458959192038, "decode_ms": 93.03074993658811, "receiver_prefill_ms": 75.07470808923244}, "total_wall_ms": 14292.996709118597, "ttft_ms": 13.430458959192038, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "26e8142bbe991631989d1ca5c21214dedae6fd0f796dae52a765cde97c9deae5", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 1460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b369df86dc6537166b4887e4", "attempt_id": "aecf818a2195", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:30.748671Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 14}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 638, "message_tokens": 547, "message_utf8_bytes": 1433, "cache_tensor_bytes": null, "serialized_payload_bytes": 1433, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14110.15425005462, "ttft_ms": 13.226458104327321, "decode_ms": 94.4082080386579, "receiver_prefill_ms": 73.31841601990163}, "total_wall_ms": 14292.383708059788, "ttft_ms": 13.226458104327321, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "26e8142bbe991631989d1ca5c21214dedae6fd0f796dae52a765cde97c9deae5", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 1461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "39e4d22bb8406446118140c0", "attempt_id": "2a04e53e9744", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:30.945118Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 14}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 648, "message_tokens": 547, "message_utf8_bytes": 1433, "cache_tensor_bytes": null, "serialized_payload_bytes": 1433, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14110.15425005462, "ttft_ms": 13.290166039951146, "decode_ms": 13.39766604360193, "receiver_prefill_ms": 75.19283390138298}, "total_wall_ms": 14213.356374995783, "ttft_ms": 13.290166039951146, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "26e8142bbe991631989d1ca5c21214dedae6fd0f796dae52a765cde97c9deae5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c8ec9682cb430a969829f401", "attempt_id": "2f2ee585a33d", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:31.062632Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 14}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 641, "message_tokens": 547, "message_utf8_bytes": 1433, "cache_tensor_bytes": null, "serialized_payload_bytes": 1433, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14110.15425005462, "ttft_ms": 13.828041031956673, "decode_ms": 132.66812497749925, "receiver_prefill_ms": 71.70620793476701}, "total_wall_ms": 14329.704083036631, "ttft_ms": 13.828041031956673, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,244,447", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "26e8142bbe991631989d1ca5c21214dedae6fd0f796dae52a765cde97c9deae5", "output_hash": "041c4a94218fbbc63e1da6dced8a0ea330f7750c6d93cf330eee091c4936494a"} | ||||
| 1463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "78b57e197b8e77576af932f8", "attempt_id": "16b99d88724c", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:31.295912Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 14}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 641, "message_tokens": 547, "message_utf8_bytes": 1433, "cache_tensor_bytes": null, "serialized_payload_bytes": 1433, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14110.15425005462, "ttft_ms": 13.43870791606605, "decode_ms": 13.248666073195636, "receiver_prefill_ms": 72.09612498991191}, "total_wall_ms": 14210.346875130199, "ttft_ms": 13.43870791606605, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "26e8142bbe991631989d1ca5c21214dedae6fd0f796dae52a765cde97c9deae5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "63825ac5beb334c1cbb53f15", "attempt_id": "ed1a3639f5a6", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:31.410060Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 14}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 643, "message_tokens": 547, "message_utf8_bytes": 1433, "cache_tensor_bytes": null, "serialized_payload_bytes": 1433, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14110.15425005462, "ttft_ms": 13.408041908405721, "decode_ms": 13.291583978570998, "receiver_prefill_ms": 74.8914999421686}, "total_wall_ms": 14213.045833050273, "ttft_ms": 13.408041908405721, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "26e8142bbe991631989d1ca5c21214dedae6fd0f796dae52a765cde97c9deae5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4f407ebbe18bda1b5b1ce0ae", "attempt_id": "d835e43a35cf", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:45.758493Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1415, "message_tokens": 1322, "message_utf8_bytes": 3365, "cache_tensor_bytes": null, "serialized_payload_bytes": 3365, "side_information_bytes": 0, "fetched_bytes": 1792, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14231.364666949958, "ttft_ms": 13.874458032660186, "decode_ms": 13.801709050312638, "receiver_prefill_ms": 151.47399995476007}, "total_wall_ms": 14412.727791932411, "ttft_ms": 13.874458032660186, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f17b17688d45b7f39f8f52663a70e30a22a28efb06855699acc9e867548eb80e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "48a92f0630f7b8814eb3e10a", "attempt_id": "39654f8d9884", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:45.954619Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1391, "message_tokens": 1301, "message_utf8_bytes": 3302, "cache_tensor_bytes": null, "serialized_payload_bytes": 3302, "side_information_bytes": 0, "fetched_bytes": 1727, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14231.364666949958, "ttft_ms": 13.841332984156907, "decode_ms": 55.17562502063811, "receiver_prefill_ms": 148.6471249954775}, "total_wall_ms": 14451.240957947448, "ttft_ms": 13.841332984156907, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DB-72", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c3c6b66ff1f2922d358e41bfd7567b290f3cf4c0308ebf80ae859f3c5269d953", "output_hash": "87ca83e01929be6b3f8de6994a2e6b49ab938a1a8dd15ee4968880f98d5f92b7"} | ||||
| 1467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2ab0a340ed478b1dc1be9f6b", "attempt_id": "b2ccec9ed407", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:46.189466Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1405, "message_tokens": 1308, "message_utf8_bytes": 3319, "cache_tensor_bytes": null, "serialized_payload_bytes": 3319, "side_information_bytes": 0, "fetched_bytes": 1745, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14231.364666949958, "ttft_ms": 13.553750002756715, "decode_ms": 97.26200008299202, "receiver_prefill_ms": 149.11612507421523}, "total_wall_ms": 14493.502416997217, "ttft_ms": 13.553750002756715, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "90077163f961765236ec89339f3613d11e838181e6b88cb141a2f8f68cd2d8ff", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 1468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "fbd63fdeeea75c08c5841b8a", "attempt_id": "8154bbeea164", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:46.466023Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1398, "message_tokens": 1308, "message_utf8_bytes": 3319, "cache_tensor_bytes": null, "serialized_payload_bytes": 3319, "side_information_bytes": 0, "fetched_bytes": 1745, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14231.364666949958, "ttft_ms": 13.884167070500553, "decode_ms": 97.9517080122605, "receiver_prefill_ms": 148.31058296840638}, "total_wall_ms": 14493.840291863307, "ttft_ms": 13.884167070500553, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "90077163f961765236ec89339f3613d11e838181e6b88cb141a2f8f68cd2d8ff", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 1469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "69e8009cf7273bdb1570d974", "attempt_id": "de6473f63c4a", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:46.743403Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1368, "message_tokens": 1268, "message_utf8_bytes": 3312, "cache_tensor_bytes": null, "serialized_payload_bytes": 3312, "side_information_bytes": 0, "fetched_bytes": 1735, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14231.364666949958, "ttft_ms": 13.741832925006747, "decode_ms": 68.19629098754376, "receiver_prefill_ms": 144.84883390832692}, "total_wall_ms": 14460.509749944322, "ttft_ms": 13.741832925006747, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Novost-15", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f75065b9ea599e2e1d5c96b191ccd822e54a59878a7ac9e589f9f7eee0ee1c5f", "output_hash": "851a475fb1ba6ddb5b9988bd32045e7b0c809becb5edebc929cce56a70ed5a5d"} | ||||
| 1470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "de13ffeccac4b5acc23706b9", "attempt_id": "42a0a9b29014", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:46.987146Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1415, "message_tokens": 1322, "message_utf8_bytes": 3365, "cache_tensor_bytes": null, "serialized_payload_bytes": 3365, "side_information_bytes": 0, "fetched_bytes": 1792, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14231.364666949958, "ttft_ms": 13.382208999246359, "decode_ms": 95.89595894794911, "receiver_prefill_ms": 150.43208305723965}, "total_wall_ms": 14493.294833926484, "ttft_ms": 13.382208999246359, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4fb1d2eac13c20331f2366348f886965516aa167cec0d5326617d0dfa8a0cf2e", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 1471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e9bb231186ecce77ea340f73", "attempt_id": "b0fefbdc209e", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:47.264346Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1394, "message_tokens": 1301, "message_utf8_bytes": 3302, "cache_tensor_bytes": null, "serialized_payload_bytes": 3302, "side_information_bytes": 0, "fetched_bytes": 1727, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14231.364666949958, "ttft_ms": 13.66433291696012, "decode_ms": 13.789082993753254, "receiver_prefill_ms": 147.96349999960512}, "total_wall_ms": 14409.027416957542, "ttft_ms": 13.66433291696012, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c3c6b66ff1f2922d358e41bfd7567b290f3cf4c0308ebf80ae859f3c5269d953", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a637e5af49e6df1942451e2b", "attempt_id": "f786dacfece8", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:47.456153Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1410, "message_tokens": 1315, "message_utf8_bytes": 3318, "cache_tensor_bytes": null, "serialized_payload_bytes": 3318, "side_information_bytes": 0, "fetched_bytes": 1745, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14231.364666949958, "ttft_ms": 13.809291063807905, "decode_ms": 13.91787501052022, "receiver_prefill_ms": 150.78795899171382}, "total_wall_ms": 14412.027666927315, "ttft_ms": 13.809291063807905, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "7be52cf7a301039a35da20ab166eb1fac7e8a0c2625d4c50f876dcd882834df8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b3edeaa43655f4bcf1188629", "attempt_id": "8663fa9c49b7", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:47.935575Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 88326144}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 8262, "cache_tensor_bytes": 88326144, "serialized_payload_bytes": 88326144, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 284.1506660915911, "ttft_ms": 31.503833015449345, "decode_ms": 99.41104205790907, "receiver_prefill_ms": 0.0}, "total_wall_ms": 419.49191608000547, "ttft_ms": 31.503833015449345, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "535,300", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "310282bc8b1d285db5e2b900f31e17e95e68f26b55e4eb87ed8d54f74105024b"} | ||||
| 1474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c4fa69d89078ea2cd709e4c1", "attempt_id": "113dc25c1021", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:48.085148Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 88326144}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 8262, "cache_tensor_bytes": 88326144, "serialized_payload_bytes": 88326144, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 284.1506660915911, "ttft_ms": 29.02508294209838, "decode_ms": 140.98566700704396, "receiver_prefill_ms": 0.0}, "total_wall_ms": 458.03991600405425, "ttft_ms": 29.02508294209838, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DD-69N-1957", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c7a79bc9b8b76dec6be02055bce804a678265ed054fadbc587c4eb56d55e06dd"} | ||||
| 1475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b9aacd7585e3c1172652901d", "attempt_id": "699c4fc7b7a5", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:48.273104Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 88326144}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 51, "message_tokens": null, "message_utf8_bytes": 8262, "cache_tensor_bytes": 88326144, "serialized_payload_bytes": 88326144, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 284.1506660915911, "ttft_ms": 29.24274990800768, "decode_ms": 98.2317499583587, "receiver_prefill_ms": 0.0}, "total_wall_ms": 415.44412507209927, "ttft_ms": 29.24274990800768, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5632215", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "dff2a8edf1f157947cce1a41ebc57f74d76214f6c6a3ee4b8447fd1333253dba"} | ||||
| 1476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1bb23e54972bada488d91a3d", "attempt_id": "156cb0f9ee5e", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:48.418306Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 88326144}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 8262, "cache_tensor_bytes": 88326144, "serialized_payload_bytes": 88326144, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 284.1506660915911, "ttft_ms": 27.50070800539106, "decode_ms": 99.4282920146361, "receiver_prefill_ms": 0.0}, "total_wall_ms": 414.89820706192404, "ttft_ms": 27.50070800539106, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5632215", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "dff2a8edf1f157947cce1a41ebc57f74d76214f6c6a3ee4b8447fd1333253dba"} | ||||
| 1477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "088cb96ce3df93244ef947c6", "attempt_id": "9a0720ff1096", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:48.562719Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 88326144}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 54, "message_tokens": null, "message_utf8_bytes": 8262, "cache_tensor_bytes": 88326144, "serialized_payload_bytes": 88326144, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 284.1506660915911, "ttft_ms": 28.828584006987512, "decode_ms": 99.24116602633148, "receiver_prefill_ms": 0.0}, "total_wall_ms": 416.13904119003564, "ttft_ms": 28.828584006987512, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 1478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "972269857842b5f0c002da6c", "attempt_id": "ad901951db5c", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:48.708735Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 88326144}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 8262, "cache_tensor_bytes": 88326144, "serialized_payload_bytes": 88326144, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 284.1506660915911, "ttft_ms": 29.08729191403836, "decode_ms": 112.94387502130121, "receiver_prefill_ms": 0.0}, "total_wall_ms": 430.3772911662236, "ttft_ms": 29.08729191403836, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14435552", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "ba9c717ba0089d9eed09e98d01b9e69c0f54309241850f2266950a76789eaba3"} | ||||
| 1479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6332ff2e9e2ffe0b20f64a1e", "attempt_id": "9514773e3c4b", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:48.870348Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 88326144}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 8262, "cache_tensor_bytes": 88326144, "serialized_payload_bytes": 88326144, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 284.1506660915911, "ttft_ms": 28.757916996255517, "decode_ms": 14.211958041414618, "receiver_prefill_ms": 0.0}, "total_wall_ms": 330.1147910533473, "ttft_ms": 28.757916996255517, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "646ddccc6fd5381444ae2368", "attempt_id": "8bead021c19f", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:48.931165Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 88326144}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 8262, "cache_tensor_bytes": 88326144, "serialized_payload_bytes": 88326144, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 284.1506660915911, "ttft_ms": 29.64787499513477, "decode_ms": 14.123957953415811, "receiver_prefill_ms": 0.0}, "total_wall_ms": 331.91920816898346, "ttft_ms": 29.64787499513477, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "76ccb4b0bd3bcb71385cb0b0", "attempt_id": "8ebc0e61fa73", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:48.993543Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2521, "message_tokens": 2432, "message_utf8_bytes": 8792, "cache_tensor_bytes": null, "serialized_payload_bytes": 8792, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026000081561505795, "ttft_ms": 13.747415971010923, "decode_ms": 96.7805830296129, "receiver_prefill_ms": 272.9843750130385}, "total_wall_ms": 387.3797501437366, "ttft_ms": 13.747415971010923, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "535,300", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b90b8ab54a04ff718678281d382d7e5b0e7dd79c8d0bdadc63dbaade42384509", "output_hash": "310282bc8b1d285db5e2b900f31e17e95e68f26b55e4eb87ed8d54f74105024b"} | ||||
| 1482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2144841f00d0a06a798e7d71", "attempt_id": "ff821251f03c", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:49.394577Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2518, "message_tokens": 2432, "message_utf8_bytes": 8792, "cache_tensor_bytes": null, "serialized_payload_bytes": 8792, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026000081561505795, "ttft_ms": 13.569499948062003, "decode_ms": 136.36124995537102, "receiver_prefill_ms": 271.18412498384714}, "total_wall_ms": 424.92104205302894, "ttft_ms": 13.569499948062003, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DB-72P-3503", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b90b8ab54a04ff718678281d382d7e5b0e7dd79c8d0bdadc63dbaade42384509", "output_hash": "051acaf42a5b0e2760fcb6fb7252c81cae4688e78f4f2cfa24c17e2daf75b9e3"} | ||||
| 1483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "97571e9de1ca6421edcb2bc3", "attempt_id": "09ceff6c4728", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:49.833552Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2525, "message_tokens": 2432, "message_utf8_bytes": 8792, "cache_tensor_bytes": null, "serialized_payload_bytes": 8792, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026000081561505795, "ttft_ms": 13.496999978087842, "decode_ms": 95.73508403263986, "receiver_prefill_ms": 272.04050007276237}, "total_wall_ms": 385.08800009731203, "ttft_ms": 13.496999978087842, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b90b8ab54a04ff718678281d382d7e5b0e7dd79c8d0bdadc63dbaade42384509", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 1484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "722663b2dcf54addeb3bb35d", "attempt_id": "2f8d108e9f03", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:50.233024Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2518, "message_tokens": 2432, "message_utf8_bytes": 8792, "cache_tensor_bytes": null, "serialized_payload_bytes": 8792, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026000081561505795, "ttft_ms": 13.704334036447108, "decode_ms": 123.62491700332612, "receiver_prefill_ms": 271.5251670451835}, "total_wall_ms": 412.6498340629041, "ttft_ms": 13.704334036447108, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,632,215", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b90b8ab54a04ff718678281d382d7e5b0e7dd79c8d0bdadc63dbaade42384509", "output_hash": "eda75ec7ef30171e592506abc3e5b148b641b914854fc239672772c94e5c3232"} | ||||
| 1485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "912b9b05ed37727d4eb13368", "attempt_id": "1268fcd2b872", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:50.659505Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2528, "message_tokens": 2432, "message_utf8_bytes": 8792, "cache_tensor_bytes": null, "serialized_payload_bytes": 8792, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026000081561505795, "ttft_ms": 13.81883304566145, "decode_ms": 69.4627920165658, "receiver_prefill_ms": 293.484624940902}, "total_wall_ms": 380.7400841033086, "ttft_ms": 13.81883304566145, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Novost-15", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b90b8ab54a04ff718678281d382d7e5b0e7dd79c8d0bdadc63dbaade42384509", "output_hash": "851a475fb1ba6ddb5b9988bd32045e7b0c809becb5edebc929cce56a70ed5a5d"} | ||||
| 1486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b2201bdd2ab6ec54e4df2796", "attempt_id": "10ca17af350f", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:51.054653Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2521, "message_tokens": 2432, "message_utf8_bytes": 8792, "cache_tensor_bytes": null, "serialized_payload_bytes": 8792, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026000081561505795, "ttft_ms": 13.545709080062807, "decode_ms": 95.07220797240734, "receiver_prefill_ms": 270.9655000362545}, "total_wall_ms": 383.55291611514986, "ttft_ms": 13.545709080062807, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2347846", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b90b8ab54a04ff718678281d382d7e5b0e7dd79c8d0bdadc63dbaade42384509", "output_hash": "42c74d29c7a4ddecc47d82b3608b9baf822d4f1b8fd2ab248d6fcb503656e384"} | ||||
| 1487 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e603126fe102e5239e6d7df4", "attempt_id": "8144b926684c", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:51.452883Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2521, "message_tokens": 2432, "message_utf8_bytes": 8792, "cache_tensor_bytes": null, "serialized_payload_bytes": 8792, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026000081561505795, "ttft_ms": 13.71395809110254, "decode_ms": 13.348375097848475, "receiver_prefill_ms": 271.22762496583164}, "total_wall_ms": 302.076542051509, "ttft_ms": 13.71395809110254, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b90b8ab54a04ff718678281d382d7e5b0e7dd79c8d0bdadc63dbaade42384509", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1488 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8de3046a14b6d3acb4bbcbca", "attempt_id": "00c662944437", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:36:51.768780Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2523, "message_tokens": 2432, "message_utf8_bytes": 8792, "cache_tensor_bytes": null, "serialized_payload_bytes": 8792, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.026000081561505795, "ttft_ms": 13.700208044610918, "decode_ms": 13.669624924659729, "receiver_prefill_ms": 277.95716701075435}, "total_wall_ms": 309.1204169904813, "ttft_ms": 13.700208044610918, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b90b8ab54a04ff718678281d382d7e5b0e7dd79c8d0bdadc63dbaade42384509", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1489 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3e0b6aaba1663ee7e8cb9cbd", "attempt_id": "98a31938f68a", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:12.618786Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1500}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1614, "message_tokens": 1524, "message_utf8_bytes": 4770, "cache_tensor_bytes": null, "serialized_payload_bytes": 4770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 20526.26595797483, "ttft_ms": 13.802000088617206, "decode_ms": 95.43770900927484, "receiver_prefill_ms": 171.59250006079674}, "total_wall_ms": 20812.575957970694, "ttft_ms": 13.802000088617206, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "535,300", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ecf5a44f55b5a0c2cfb61d3be37f3d239f5f933dcd1227578cf96f16f839a7be", "output_hash": "310282bc8b1d285db5e2b900f31e17e95e68f26b55e4eb87ed8d54f74105024b"} | ||||
| 1490 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c9150d055855ce701643649e", "attempt_id": "3caab6d8a381", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:12.920182Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1500}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1611, "message_tokens": 1524, "message_utf8_bytes": 4770, "cache_tensor_bytes": null, "serialized_payload_bytes": 4770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 20526.26595797483, "ttft_ms": 13.629000051878393, "decode_ms": 134.59487492218614, "receiver_prefill_ms": 170.70274997968227}, "total_wall_ms": 20847.8197499644, "ttft_ms": 13.629000051878393, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DB-72P-3503", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ecf5a44f55b5a0c2cfb61d3be37f3d239f5f933dcd1227578cf96f16f839a7be", "output_hash": "051acaf42a5b0e2760fcb6fb7252c81cae4688e78f4f2cfa24c17e2daf75b9e3"} | ||||
| 1491 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a52d968fca241b9a6f6141c0", "attempt_id": "66579940a204", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:13.256177Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1500}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1618, "message_tokens": 1524, "message_utf8_bytes": 4770, "cache_tensor_bytes": null, "serialized_payload_bytes": 4770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 20526.26595797483, "ttft_ms": 13.731667073443532, "decode_ms": 96.73404204659164, "receiver_prefill_ms": 171.3238749653101}, "total_wall_ms": 20810.726124909706, "ttft_ms": 13.731667073443532, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5632215", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ecf5a44f55b5a0c2cfb61d3be37f3d239f5f933dcd1227578cf96f16f839a7be", "output_hash": "dff2a8edf1f157947cce1a41ebc57f74d76214f6c6a3ee4b8447fd1333253dba"} | ||||
| 1492 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "7f1245ef3d4fe7ed2eeace6f", "attempt_id": "988a2dd96ed6", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:13.555303Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1500}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1611, "message_tokens": 1524, "message_utf8_bytes": 4770, "cache_tensor_bytes": null, "serialized_payload_bytes": 4770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 20526.26595797483, "ttft_ms": 13.817999977618456, "decode_ms": 122.9941250057891, "receiver_prefill_ms": 170.25370802730322}, "total_wall_ms": 20835.99662396591, "ttft_ms": 13.817999977618456, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ecf5a44f55b5a0c2cfb61d3be37f3d239f5f933dcd1227578cf96f16f839a7be", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 1493 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "319d40d4e52c17a967560258", "attempt_id": "406233935142", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:13.880573Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1500}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1621, "message_tokens": 1524, "message_utf8_bytes": 4770, "cache_tensor_bytes": null, "serialized_payload_bytes": 4770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 20526.26595797483, "ttft_ms": 13.538833940401673, "decode_ms": 67.90708296466619, "receiver_prefill_ms": 170.2840420184657}, "total_wall_ms": 20780.672374996357, "ttft_ms": 13.538833940401673, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Novost-15", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ecf5a44f55b5a0c2cfb61d3be37f3d239f5f933dcd1227578cf96f16f839a7be", "output_hash": "851a475fb1ba6ddb5b9988bd32045e7b0c809becb5edebc929cce56a70ed5a5d"} | ||||
| 1494 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "04decc11ef704ba043fa516d", "attempt_id": "357c45023461", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:14.150603Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1500}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1614, "message_tokens": 1524, "message_utf8_bytes": 4770, "cache_tensor_bytes": null, "serialized_payload_bytes": 4770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 20526.26595797483, "ttft_ms": 13.540958985686302, "decode_ms": 110.25925003923476, "receiver_prefill_ms": 170.5873750615865}, "total_wall_ms": 20823.310791049153, "ttft_ms": 13.540958985686302, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15233452", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ecf5a44f55b5a0c2cfb61d3be37f3d239f5f933dcd1227578cf96f16f839a7be", "output_hash": "946ed57d0fc8dad61733bd4e020c2c84a76dd92fce748c4069c1d2fd0c982b96"} | ||||
| 1495 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2d36e9d22df210bc58b6c032", "attempt_id": "a75595a9dd2e", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:14.462245Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1500}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1614, "message_tokens": 1524, "message_utf8_bytes": 4770, "cache_tensor_bytes": null, "serialized_payload_bytes": 4770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 20526.26595797483, "ttft_ms": 13.848332921043038, "decode_ms": 13.349708053283393, "receiver_prefill_ms": 170.14595796354115}, "total_wall_ms": 20726.210165885277, "ttft_ms": 13.848332921043038, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ecf5a44f55b5a0c2cfb61d3be37f3d239f5f933dcd1227578cf96f16f839a7be", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1496 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "17e1aaeedfb5d9ef640d2d5a", "attempt_id": "0e329e940c1c", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:14.677174Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1500}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1616, "message_tokens": 1524, "message_utf8_bytes": 4770, "cache_tensor_bytes": null, "serialized_payload_bytes": 4770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 20526.26595797483, "ttft_ms": 13.489958015270531, "decode_ms": 13.593000010587275, "receiver_prefill_ms": 174.63408398907632}, "total_wall_ms": 20730.535249924287, "ttft_ms": 13.489958015270531, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ecf5a44f55b5a0c2cfb61d3be37f3d239f5f933dcd1227578cf96f16f839a7be", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1497 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "baadedabdf1638035fbd9759", "attempt_id": "df0ba3b67656", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:42.386260Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1226, "message_tokens": 1132, "message_utf8_bytes": 2946, "cache_tensor_bytes": null, "serialized_payload_bytes": 2946, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27489.781958051026, "ttft_ms": 13.474542065523565, "decode_ms": 13.51316599175334, "receiver_prefill_ms": 128.8720000302419}, "total_wall_ms": 27647.48529100325, "ttft_ms": 13.474542065523565, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "eb9ca57a5f1773ebf9f8ef83836be66d79f66df18fed066692f9f3ccd4e24a12", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1498 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "55a3f4d7fd2c23d9b99b24e6", "attempt_id": "77ea19eee567", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:42.559050Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1223, "message_tokens": 1132, "message_utf8_bytes": 2946, "cache_tensor_bytes": null, "serialized_payload_bytes": 2946, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27489.781958051026, "ttft_ms": 13.511916040442884, "decode_ms": 13.783792033791542, "receiver_prefill_ms": 139.2971669556573}, "total_wall_ms": 27658.18783303257, "ttft_ms": 13.511916040442884, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "eb9ca57a5f1773ebf9f8ef83836be66d79f66df18fed066692f9f3ccd4e24a12", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1499 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0a032a6aafaafd10ebac965a", "attempt_id": "3ee8388af5bf", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:42.741647Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1230, "message_tokens": 1132, "message_utf8_bytes": 2946, "cache_tensor_bytes": null, "serialized_payload_bytes": 2946, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27489.781958051026, "ttft_ms": 13.613332994282246, "decode_ms": 120.27341697830707, "receiver_prefill_ms": 483.9315420249477}, "total_wall_ms": 28109.482291038148, "ttft_ms": 13.613332994282246, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "eb9ca57a5f1773ebf9f8ef83836be66d79f66df18fed066692f9f3ccd4e24a12", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 1500 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b7482e845f9639a3ee176238", "attempt_id": "5ba6c7141e87", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:43.375433Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1223, "message_tokens": 1132, "message_utf8_bytes": 2946, "cache_tensor_bytes": null, "serialized_payload_bytes": 2946, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27489.781958051026, "ttft_ms": 13.337749987840652, "decode_ms": 122.78008298017085, "receiver_prefill_ms": 127.85095896106213}, "total_wall_ms": 27755.644750082865, "ttft_ms": 13.337749987840652, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "eb9ca57a5f1773ebf9f8ef83836be66d79f66df18fed066692f9f3ccd4e24a12", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 1501 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "45f9ff8b9d84bb378b97f725", "attempt_id": "14b307692e32", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:43.655827Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1233, "message_tokens": 1132, "message_utf8_bytes": 2946, "cache_tensor_bytes": null, "serialized_payload_bytes": 2946, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27489.781958051026, "ttft_ms": 15.502625028602779, "decode_ms": 97.84783306531608, "receiver_prefill_ms": 736.1515830270946}, "total_wall_ms": 28341.198957990855, "ttft_ms": 15.502625028602779, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "eb9ca57a5f1773ebf9f8ef83836be66d79f66df18fed066692f9f3ccd4e24a12", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 1502 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9c1193bcd0438a7e0f40d930", "attempt_id": "26e1353a4e6e", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:44.522471Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1226, "message_tokens": 1132, "message_utf8_bytes": 2946, "cache_tensor_bytes": null, "serialized_payload_bytes": 2946, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27489.781958051026, "ttft_ms": 13.474000035785139, "decode_ms": 93.42749998904765, "receiver_prefill_ms": 128.0549590010196}, "total_wall_ms": 27726.70045797713, "ttft_ms": 13.474000035785139, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1589105", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "eb9ca57a5f1773ebf9f8ef83836be66d79f66df18fed066692f9f3ccd4e24a12", "output_hash": "acce284e21562feb849550dc8d18291445fec57d4ba5820f4463d785f57cda4b"} | ||||
| 1503 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "7c49e6e0d8d086bfe86ee8cc", "attempt_id": "7290f8250317", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:44.776203Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1226, "message_tokens": 1132, "message_utf8_bytes": 2946, "cache_tensor_bytes": null, "serialized_payload_bytes": 2946, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27489.781958051026, "ttft_ms": 13.326958054676652, "decode_ms": 13.396458933129907, "receiver_prefill_ms": 127.58637499064207}, "total_wall_ms": 27645.919333095662, "ttft_ms": 13.326958054676652, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "eb9ca57a5f1773ebf9f8ef83836be66d79f66df18fed066692f9f3ccd4e24a12", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1504 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6c9f1e24e67316b8dc41157c", "attempt_id": "548c7468f87f", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:37:44.946758Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 29}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 1228, "message_tokens": 1132, "message_utf8_bytes": 2946, "cache_tensor_bytes": null, "serialized_payload_bytes": 2946, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27489.781958051026, "ttft_ms": 13.738499954342842, "decode_ms": 14.123000088147819, "receiver_prefill_ms": 572.6238330826163}, "total_wall_ms": 28092.158875078894, "ttft_ms": 13.738499954342842, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "eb9ca57a5f1773ebf9f8ef83836be66d79f66df18fed066692f9f3ccd4e24a12", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1505 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c4a1a2336088ec54075a5fac", "attempt_id": "331db7ec40b3", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:13.185992Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2576, "message_tokens": 2483, "message_utf8_bytes": 6375, "cache_tensor_bytes": null, "serialized_payload_bytes": 6375, "side_information_bytes": 0, "fetched_bytes": 3418, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27622.584290918894, "ttft_ms": 13.501208974048495, "decode_ms": 13.318917015567422, "receiver_prefill_ms": 343.48633291665465}, "total_wall_ms": 27996.434332919307, "ttft_ms": 13.501208974048495, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "a44d9d91a96f269b4982b6ff2179f485307aba968d8d8b97ed735111b2ae44b0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1506 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f3b424cffc9c0c35bcb0824b", "attempt_id": "83fd68e12f78", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:13.580224Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2454, "message_tokens": 2364, "message_utf8_bytes": 6181, "cache_tensor_bytes": null, "serialized_payload_bytes": 6181, "side_information_bytes": 0, "fetched_bytes": 3214, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27622.584290918894, "ttft_ms": 14.383958070538938, "decode_ms": 41.993791004642844, "receiver_prefill_ms": 376.38120795600116}, "total_wall_ms": 28058.661248884164, "ttft_ms": 14.383958070538938, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DB-7", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "0787dcb36719e1685552d936599bfb3b643e94a5710e7b04a5a35396bdac6a6e", "output_hash": "9197d14a5517d200b55deb6c8141414f24265c8fda55f6ff69a5df1a857e1843"} | ||||
| 1507 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c08cb1363141a9c90dd4d601", "attempt_id": "9fddbbd0b402", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:14.030733Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2599, "message_tokens": 2502, "message_utf8_bytes": 6413, "cache_tensor_bytes": null, "serialized_payload_bytes": 6413, "side_information_bytes": 0, "fetched_bytes": 3458, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27622.584290918894, "ttft_ms": 13.529125018976629, "decode_ms": 94.11170799285173, "receiver_prefill_ms": 283.0470419721678}, "total_wall_ms": 28016.752248979174, "ttft_ms": 13.529125018976629, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f7192125b3f411c61fac414a6d435b272183a04cae68fc3456b1f0b16a90dacc", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 1508 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b4d1fac0ef1723704ab217b8", "attempt_id": "cc4271d6e3ed", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:14.442318Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2592, "message_tokens": 2502, "message_utf8_bytes": 6413, "cache_tensor_bytes": null, "serialized_payload_bytes": 6413, "side_information_bytes": 0, "fetched_bytes": 3458, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27622.584290918894, "ttft_ms": 14.233208959922194, "decode_ms": 96.33045899681747, "receiver_prefill_ms": 320.92116598505527}, "total_wall_ms": 28057.45874985587, "ttft_ms": 14.233208959922194, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f7192125b3f411c61fac414a6d435b272183a04cae68fc3456b1f0b16a90dacc", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 1509 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "372475fc1e51118002294b99", "attempt_id": "25e0fd2877a3", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:14.891428Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2553, "message_tokens": 2453, "message_utf8_bytes": 6296, "cache_tensor_bytes": null, "serialized_payload_bytes": 6296, "side_information_bytes": 0, "fetched_bytes": 3344, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27622.584290918894, "ttft_ms": 13.588959001936018, "decode_ms": 95.12404189445078, "receiver_prefill_ms": 272.90383295621723}, "total_wall_ms": 28007.517748861574, "ttft_ms": 13.588959001936018, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e7107c530380b29d0aea1ce99d6f81e40bd82288a5617562f297cf591651cdc2", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 1510 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "95c3e47e05a1ab9d741f8d76", "attempt_id": "65c3a0cd3984", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:15.291134Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2595, "message_tokens": 2502, "message_utf8_bytes": 6413, "cache_tensor_bytes": null, "serialized_payload_bytes": 6413, "side_information_bytes": 0, "fetched_bytes": 3458, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27622.584290918894, "ttft_ms": 13.745249947533011, "decode_ms": 134.22658306080848, "receiver_prefill_ms": 282.1164169581607}, "total_wall_ms": 28056.00641586352, "ttft_ms": 13.745249947533011, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21,111,712", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "968b654012b9186fbaa40cd5287808fcfd5329b10f697b795bfcd770a84d5d43", "output_hash": "9d15dcc112d5a8472d06eca5b1d0a107988256fc705559bf1ce1606046ac5e60"} | ||||
| 1511 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6106c53fb841f62e4233340b", "attempt_id": "9f06ef650bdd", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:15.739420Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2508, "message_tokens": 2415, "message_utf8_bytes": 6331, "cache_tensor_bytes": null, "serialized_payload_bytes": 6331, "side_information_bytes": 0, "fetched_bytes": 3344, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27622.584290918894, "ttft_ms": 13.826583046466112, "decode_ms": 13.85670795571059, "receiver_prefill_ms": 314.5611659856513}, "total_wall_ms": 27968.10504095629, "ttft_ms": 13.826583046466112, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "4bdbd4670ef7f81c5338ee017970ba7257269aa84389c240aacf8ade520ed9ef", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1512 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "08f601663240d6ebff5e8dae", "attempt_id": "88d27028e3fa", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:16.099945Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 2578, "message_tokens": 2483, "message_utf8_bytes": 6375, "cache_tensor_bytes": null, "serialized_payload_bytes": 6375, "side_information_bytes": 0, "fetched_bytes": 3418, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27622.584290918894, "ttft_ms": 13.81716609466821, "decode_ms": 13.62275006249547, "receiver_prefill_ms": 291.97179106995463}, "total_wall_ms": 27945.460707880557, "ttft_ms": 13.81716609466821, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c379375be543f7921a862922d44f13ca776a3adc25a8fb4dbf59f298c01e9a31", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1513 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "91ed6e8a7351d6c3f936996a", "attempt_id": "50d72987c791", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:16.840375Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 95404032}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 8738, "cache_tensor_bytes": 95404032, "serialized_payload_bytes": 95404032, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 402.01320801861584, "ttft_ms": 33.228709013201296, "decode_ms": 84.95041693095118, "receiver_prefill_ms": 0.0}, "total_wall_ms": 523.9856659900397, "ttft_ms": 33.228709013201296, "input_usage": {}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "535300", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "fc689fe95e517c971459f8d7a6abbbf8873a56ea6a4493a05c86e332dc7659e2"} | ||||
| 1514 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5900a046d7d45e371663ec75", "attempt_id": "6df4c1e22108", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:16.977315Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 95404032}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 8738, "cache_tensor_bytes": 95404032, "serialized_payload_bytes": 95404032, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 402.01320801861584, "ttft_ms": 28.73795898631215, "decode_ms": 139.19545896351337, "receiver_prefill_ms": 0.0}, "total_wall_ms": 573.0392909608781, "ttft_ms": 28.73795898631215, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DD-69N-1957", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c7a79bc9b8b76dec6be02055bce804a678265ed054fadbc587c4eb56d55e06dd"} | ||||
| 1515 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "20502c201a6d13ba456edc83", "attempt_id": "b22bfd06811f", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:17.163210Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 95404032}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 51, "message_tokens": null, "message_utf8_bytes": 8738, "cache_tensor_bytes": 95404032, "serialized_payload_bytes": 95404032, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 402.01320801861584, "ttft_ms": 30.972167034633458, "decode_ms": 101.72241600230336, "receiver_prefill_ms": 0.0}, "total_wall_ms": 537.7437500283122, "ttft_ms": 30.972167034633458, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5632215", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "dff2a8edf1f157947cce1a41ebc57f74d76214f6c6a3ee4b8447fd1333253dba"} | ||||
| 1516 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "bc18051a4cbe7f14bd4ad2a7", "attempt_id": "78031e1fdbbf", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:17.313415Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 95404032}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 8738, "cache_tensor_bytes": 95404032, "serialized_payload_bytes": 95404032, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 402.01320801861584, "ttft_ms": 28.50220794789493, "decode_ms": 97.76454197708517, "receiver_prefill_ms": 0.0}, "total_wall_ms": 531.184250023216, "ttft_ms": 28.50220794789493, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5632215", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "dff2a8edf1f157947cce1a41ebc57f74d76214f6c6a3ee4b8447fd1333253dba"} | ||||
| 1517 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "906b85ba834d280cb5fa428f", "attempt_id": "9bdb715d3bac", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:17.457854Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 95404032}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 54, "message_tokens": null, "message_utf8_bytes": 8738, "cache_tensor_bytes": 95404032, "serialized_payload_bytes": 95404032, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 402.01320801861584, "ttft_ms": 29.76112498436123, "decode_ms": 97.67175000160933, "receiver_prefill_ms": 0.0}, "total_wall_ms": 532.5968739343807, "ttft_ms": 29.76112498436123, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 1518 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3e334213ca93c286c2f6f01b", "attempt_id": "1db7478084a7", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:17.603010Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 95404032}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 8738, "cache_tensor_bytes": 95404032, "serialized_payload_bytes": 95404032, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 402.01320801861584, "ttft_ms": 29.825582983903587, "decode_ms": 111.74766696058214, "receiver_prefill_ms": 0.0}, "total_wall_ms": 546.6306660091504, "ttft_ms": 29.825582983903587, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14212622", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "dedcb11be6d709824001d75c7e619b4850c7ba6f3d8f91811d8586f369d66903"} | ||||
| 1519 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "7ffa379a6e82d2a4053549f0", "attempt_id": "7d577407b505", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:17.762321Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 95404032}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 8738, "cache_tensor_bytes": 95404032, "serialized_payload_bytes": 95404032, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 402.01320801861584, "ttft_ms": 29.81837501283735, "decode_ms": 13.92462500371039, "receiver_prefill_ms": 0.0}, "total_wall_ms": 449.0244999760762, "ttft_ms": 29.81837501283735, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1520 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "de91d30798274bed9ddca66d", "attempt_id": "7bf8b0911391", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:17.823560Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 95404032}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 8738, "cache_tensor_bytes": 95404032, "serialized_payload_bytes": 95404032, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 402.01320801861584, "ttft_ms": 30.746832955628633, "decode_ms": 13.972665998153389, "receiver_prefill_ms": 0.0}, "total_wall_ms": 449.8988330597058, "ttft_ms": 30.746832955628633, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Sollith-4", "bogus_amount": "5,632,215", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1521 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "cd1de282312e9a6a4a36da26", "attempt_id": "95eb39e50ada", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:18.818081Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6249, "message_tokens": 6163, "message_utf8_bytes": 30147, "cache_tensor_bytes": null, "serialized_payload_bytes": 30147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.035415985621511936, "ttft_ms": 13.989083003252745, "decode_ms": 109.78400008752942, "receiver_prefill_ms": 744.913375005126}, "total_wall_ms": 878.7341250572354, "ttft_ms": 13.989083003252745, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "549,950 EUR", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "900139fea49a30dd0078ecbe42e8fa0dbddfd1684d4c3fe6d000ec06147f0ac3", "output_hash": "c4834b6c2ddcc337bd255fb6f2c9f51520d4e94c30b827d39f041d1e90d764ce"} | ||||
| 1522 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "295ec1ee200cf671905ded5b", "attempt_id": "0c92bb039dc2", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:19.713311Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6250, "message_tokens": 6163, "message_utf8_bytes": 30147, "cache_tensor_bytes": null, "serialized_payload_bytes": 30147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.035415985621511936, "ttft_ms": 14.207542059011757, "decode_ms": 138.16983392462134, "receiver_prefill_ms": 731.6718340152875}, "total_wall_ms": 893.9878739183769, "ttft_ms": 14.207542059011757, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PB-38S-9552", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "900139fea49a30dd0078ecbe42e8fa0dbddfd1684d4c3fe6d000ec06147f0ac3", "output_hash": "2ead15278e346194e16500a37d0e52a9739df0cf36c158fed043974d95161e89"} | ||||
| 1523 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c68e6d3679a36604723b6a96", "attempt_id": "3dc3fef7e3ed", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:20.624397Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6257, "message_tokens": 6163, "message_utf8_bytes": 30147, "cache_tensor_bytes": null, "serialized_payload_bytes": 30147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.035415985621511936, "ttft_ms": 13.839625054970384, "decode_ms": 95.94604093581438, "receiver_prefill_ms": 732.6376250712201}, "total_wall_ms": 851.8903750227764, "ttft_ms": 13.839625054970384, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "900139fea49a30dd0078ecbe42e8fa0dbddfd1684d4c3fe6d000ec06147f0ac3", "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1524 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "de386e89f96871a8d0e8036e", "attempt_id": "46ff4a14b8d2", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:21.493535Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6250, "message_tokens": 6163, "message_utf8_bytes": 30147, "cache_tensor_bytes": null, "serialized_payload_bytes": 30147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.035415985621511936, "ttft_ms": 13.864375068806112, "decode_ms": 96.03904106188565, "receiver_prefill_ms": 732.1783329825848}, "total_wall_ms": 851.7837909748778, "ttft_ms": 13.864375068806112, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "900139fea49a30dd0078ecbe42e8fa0dbddfd1684d4c3fe6d000ec06147f0ac3", "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1525 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a3f7ad015a81b5005bc9410d", "attempt_id": "cbe9e00d5e26", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:22.361877Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6257, "message_tokens": 6163, "message_utf8_bytes": 30147, "cache_tensor_bytes": null, "serialized_payload_bytes": 30147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.035415985621511936, "ttft_ms": 14.23920807428658, "decode_ms": 70.00312500167638, "receiver_prefill_ms": 735.4718339629471}, "total_wall_ms": 829.2623319430277, "ttft_ms": 14.23920807428658, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felard-13", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "900139fea49a30dd0078ecbe42e8fa0dbddfd1684d4c3fe6d000ec06147f0ac3", "output_hash": "3148a4375aedadf07a17298878dde115102f658fb7bebe944a013c9b53bec240"} | ||||
| 1526 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "91871f11ab4959fff81aad87", "attempt_id": "af4e64001216", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:23.207711Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6252, "message_tokens": 6163, "message_utf8_bytes": 30147, "cache_tensor_bytes": null, "serialized_payload_bytes": 30147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.035415985621511936, "ttft_ms": 13.687415979802608, "decode_ms": 138.01412505563349, "receiver_prefill_ms": 742.2421249793842}, "total_wall_ms": 903.5595409804955, "ttft_ms": 13.687415979802608, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44,149,995", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "900139fea49a30dd0078ecbe42e8fa0dbddfd1684d4c3fe6d000ec06147f0ac3", "output_hash": "40a1919ac43e538e1d9037d7b31dc9a2d788e76c77cf70f89b16b2b6ad6f7b18"} | ||||
| 1527 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "89489c4a88516b8a8acc4062", "attempt_id": "ad001c067984", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:24.128524Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6252, "message_tokens": 6163, "message_utf8_bytes": 30147, "cache_tensor_bytes": null, "serialized_payload_bytes": 30147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.035415985621511936, "ttft_ms": 13.56999995186925, "decode_ms": 13.789708027616143, "receiver_prefill_ms": 740.81574997399}, "total_wall_ms": 777.688249014318, "ttft_ms": 13.56999995186925, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "900139fea49a30dd0078ecbe42e8fa0dbddfd1684d4c3fe6d000ec06147f0ac3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1528 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f6dcbb853ee3aef0d49e4953", "attempt_id": "eced7537b00d", "run_group_id": "E5_core:full_context|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:24.923140Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6254, "message_tokens": 6163, "message_utf8_bytes": 30147, "cache_tensor_bytes": null, "serialized_payload_bytes": 30147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.035415985621511936, "ttft_ms": 13.857875019311905, "decode_ms": 13.719791080802679, "receiver_prefill_ms": 748.0398750631139}, "total_wall_ms": 785.2222908986732, "ttft_ms": 13.857875019311905, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "900139fea49a30dd0078ecbe42e8fa0dbddfd1684d4c3fe6d000ec06147f0ac3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1529 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "985d0ab443c33b552f4d7bb1", "attempt_id": "7455d29f9fd2", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:40.291683Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1124, "message_tokens": 1037, "message_utf8_bytes": 2825, "cache_tensor_bytes": null, "serialized_payload_bytes": 2825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14565.942666959018, "ttft_ms": 13.322041020728648, "decode_ms": 94.27224996034056, "receiver_prefill_ms": 121.7627499718219}, "total_wall_ms": 14797.277083969675, "ttft_ms": 13.322041020728648, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "151d065dca4aa59d8fb9d6e010f80e0737ece0c9b7924ad35c32e329f35af84d", "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1530 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c4ef7cd9ac11f9f4e66264b3", "attempt_id": "b8471fd35a4e", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:40.540646Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1125, "message_tokens": 1037, "message_utf8_bytes": 2825, "cache_tensor_bytes": null, "serialized_payload_bytes": 2825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14565.942666959018, "ttft_ms": 13.746540993452072, "decode_ms": 135.76487498357892, "receiver_prefill_ms": 120.58391701430082}, "total_wall_ms": 14838.071958976798, "ttft_ms": 13.746540993452072, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PB-38S-9552", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "151d065dca4aa59d8fb9d6e010f80e0737ece0c9b7924ad35c32e329f35af84d", "output_hash": "2ead15278e346194e16500a37d0e52a9739df0cf36c158fed043974d95161e89"} | ||||
| 1531 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b626bbd9643b5f405dbef136", "attempt_id": "a569463fbd49", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:40.830438Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1132, "message_tokens": 1037, "message_utf8_bytes": 2825, "cache_tensor_bytes": null, "serialized_payload_bytes": 2825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14565.942666959018, "ttft_ms": 13.365166960284114, "decode_ms": 94.74395797587931, "receiver_prefill_ms": 121.7123749665916}, "total_wall_ms": 14797.758791944943, "ttft_ms": 13.365166960284114, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "603,595", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "151d065dca4aa59d8fb9d6e010f80e0737ece0c9b7924ad35c32e329f35af84d", "output_hash": "19f63ee7169f83e8e0256e7a4a4a68fa5980ea55ef086b8b373177c1d02539bc"} | ||||
| 1532 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d4124e6075f8a9604c646581", "attempt_id": "ff011d3d49ef", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:41.083278Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1125, "message_tokens": 1037, "message_utf8_bytes": 2825, "cache_tensor_bytes": null, "serialized_payload_bytes": 2825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14565.942666959018, "ttft_ms": 13.358833035454154, "decode_ms": 94.34662503190339, "receiver_prefill_ms": 120.74537493754178}, "total_wall_ms": 14796.287126024254, "ttft_ms": 13.358833035454154, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "151d065dca4aa59d8fb9d6e010f80e0737ece0c9b7924ad35c32e329f35af84d", "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1533 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "35dff6aa97f8d092dba3540e", "attempt_id": "1c8c7bab14f5", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:41.329957Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1132, "message_tokens": 1037, "message_utf8_bytes": 2825, "cache_tensor_bytes": null, "serialized_payload_bytes": 2825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14565.942666959018, "ttft_ms": 13.397749979048967, "decode_ms": 67.36020802054554, "receiver_prefill_ms": 120.75937504414469}, "total_wall_ms": 14769.339166930877, "ttft_ms": 13.397749979048967, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felard-13", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "151d065dca4aa59d8fb9d6e010f80e0737ece0c9b7924ad35c32e329f35af84d", "output_hash": "3148a4375aedadf07a17298878dde115102f658fb7bebe944a013c9b53bec240"} | ||||
| 1534 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a43d83eb7cb29f177523b020", "attempt_id": "2bbce92abfc6", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:41.550373Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1127, "message_tokens": 1037, "message_utf8_bytes": 2825, "cache_tensor_bytes": null, "serialized_payload_bytes": 2825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14565.942666959018, "ttft_ms": 13.514458085410297, "decode_ms": 120.91212498489767, "receiver_prefill_ms": 121.30154203623533}, "total_wall_ms": 14823.65087501239, "ttft_ms": 13.514458085410297, "input_usage": {}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "34024.145", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "151d065dca4aa59d8fb9d6e010f80e0737ece0c9b7924ad35c32e329f35af84d", "output_hash": "2b4cea98a1c37694861ded9200fa7c12e5226877d9b114d124bd5aac8270b076"} | ||||
| 1535 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d7c846df87fe7db476adb024", "attempt_id": "aab2180fe453", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:41.825295Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1127, "message_tokens": 1037, "message_utf8_bytes": 2825, "cache_tensor_bytes": null, "serialized_payload_bytes": 2825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14565.942666959018, "ttft_ms": 13.363166013732553, "decode_ms": 13.457249966450036, "receiver_prefill_ms": 121.40012509189546}, "total_wall_ms": 14716.055458877236, "ttft_ms": 13.363166013732553, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "151d065dca4aa59d8fb9d6e010f80e0737ece0c9b7924ad35c32e329f35af84d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1536 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0c45664e9fbf127d3bf8c0d6", "attempt_id": "a8509fc5b506", "run_group_id": "E5_core:concat_A4|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:41.992866Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "sender_tokens": 1024}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1129, "message_tokens": 1037, "message_utf8_bytes": 2825, "cache_tensor_bytes": null, "serialized_payload_bytes": 2825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 14565.942666959018, "ttft_ms": 13.547584065236151, "decode_ms": 13.681709067896008, "receiver_prefill_ms": 121.35795806534588}, "total_wall_ms": 14716.467458987609, "ttft_ms": 13.547584065236151, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "151d065dca4aa59d8fb9d6e010f80e0737ece0c9b7924ad35c32e329f35af84d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1537 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "112a07bbaa686c178d2f7524", "attempt_id": "e76da0d9998c", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:54.215525Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 11}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 535, "message_tokens": 444, "message_utf8_bytes": 1193, "cache_tensor_bytes": null, "serialized_payload_bytes": 1193, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12055.380290956236, "ttft_ms": 13.085917104035616, "decode_ms": 13.471207930706441, "receiver_prefill_ms": 64.34062495827675}, "total_wall_ms": 12153.142706956714, "ttft_ms": 13.085917104035616, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "51175a30c775ae640d138df42dd84cc82b8f6f0eef31d48ae508ea70fd116fe5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1538 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9f32b62d17eb7c03439e5dbb", "attempt_id": "11fd468c0407", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:54.330882Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 11}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 536, "message_tokens": 444, "message_utf8_bytes": 1193, "cache_tensor_bytes": null, "serialized_payload_bytes": 1193, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12055.380290956236, "ttft_ms": 13.279999955557287, "decode_ms": 13.302500010468066, "receiver_prefill_ms": 64.39266703091562}, "total_wall_ms": 12147.493958007544, "ttft_ms": 13.279999955557287, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "51175a30c775ae640d138df42dd84cc82b8f6f0eef31d48ae508ea70fd116fe5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1539 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a9d42622602eed42ca94a8bc", "attempt_id": "c7de5b15b398", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:54.440591Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 11}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 543, "message_tokens": 444, "message_utf8_bytes": 1193, "cache_tensor_bytes": null, "serialized_payload_bytes": 1193, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12055.380290956236, "ttft_ms": 13.592165894806385, "decode_ms": 13.167624943889678, "receiver_prefill_ms": 64.24829200841486}, "total_wall_ms": 12147.520790924318, "ttft_ms": 13.592165894806385, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "51175a30c775ae640d138df42dd84cc82b8f6f0eef31d48ae508ea70fd116fe5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1540 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "288716e136cfedb090e0c4d8", "attempt_id": "21709a393c98", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:54.550311Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 11}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 536, "message_tokens": 444, "message_utf8_bytes": 1193, "cache_tensor_bytes": null, "serialized_payload_bytes": 1193, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12055.380290956236, "ttft_ms": 13.230041950009763, "decode_ms": 13.309958972968161, "receiver_prefill_ms": 64.05245803762227}, "total_wall_ms": 12147.104832925834, "ttft_ms": 13.230041950009763, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "51175a30c775ae640d138df42dd84cc82b8f6f0eef31d48ae508ea70fd116fe5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1541 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1860a27b19ed37d0444448ba", "attempt_id": "8d8ab541c15c", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:54.659154Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 11}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 543, "message_tokens": 444, "message_utf8_bytes": 1193, "cache_tensor_bytes": null, "serialized_payload_bytes": 1193, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12055.380290956236, "ttft_ms": 13.31208401825279, "decode_ms": 67.04100000206381, "receiver_prefill_ms": 64.25454199779779}, "total_wall_ms": 12201.149957953021, "ttft_ms": 13.31208401825279, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felard-13", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "51175a30c775ae640d138df42dd84cc82b8f6f0eef31d48ae508ea70fd116fe5", "output_hash": "3148a4375aedadf07a17298878dde115102f658fb7bebe944a013c9b53bec240"} | ||||
| 1542 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "fb31ea512ba7e3ed7860d93c", "attempt_id": "8d73212957d8", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:54.821917Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 11}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 538, "message_tokens": 444, "message_utf8_bytes": 1193, "cache_tensor_bytes": null, "serialized_payload_bytes": 1193, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12055.380290956236, "ttft_ms": 13.527916045859456, "decode_ms": 93.64537498913705, "receiver_prefill_ms": 64.35816595330834}, "total_wall_ms": 12228.103874949738, "ttft_ms": 13.527916045859456, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2333595", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "51175a30c775ae640d138df42dd84cc82b8f6f0eef31d48ae508ea70fd116fe5", "output_hash": "e1a46be96c350176b34fe6c169a1d48a9f809d6e87325d053a5955ec1485f300"} | ||||
| 1543 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "8f61d2cdf9219975703a1287", "attempt_id": "a28474b40af4", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:55.011932Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 11}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 538, "message_tokens": 444, "message_utf8_bytes": 1193, "cache_tensor_bytes": null, "serialized_payload_bytes": 1193, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12055.380290956236, "ttft_ms": 13.129665981978178, "decode_ms": 13.177125016227365, "receiver_prefill_ms": 64.38358302693814}, "total_wall_ms": 12147.220165934414, "ttft_ms": 13.129665981978178, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "51175a30c775ae640d138df42dd84cc82b8f6f0eef31d48ae508ea70fd116fe5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1544 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "9090c8fcd986e8b59e78c9d2", "attempt_id": "98be251ebda7", "run_group_id": "E5_core:merge_A5|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:38:55.121224Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512, "n_facts": 11}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 540, "message_tokens": 444, "message_utf8_bytes": 1193, "cache_tensor_bytes": null, "serialized_payload_bytes": 1193, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12055.380290956236, "ttft_ms": 13.198708067648113, "decode_ms": 13.752583065070212, "receiver_prefill_ms": 64.11479099188}, "total_wall_ms": 12147.59041601792, "ttft_ms": 13.198708067648113, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "51175a30c775ae640d138df42dd84cc82b8f6f0eef31d48ae508ea70fd116fe5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1545 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "93e244f6fde9f68053d96564", "attempt_id": "0070e40ff40e", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:07.306815Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1319, "message_tokens": 1229, "message_utf8_bytes": 3083, "cache_tensor_bytes": null, "serialized_payload_bytes": 3083, "side_information_bytes": 0, "fetched_bytes": 1729, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12073.418041924015, "ttft_ms": 13.415541965514421, "decode_ms": 94.07912497408688, "receiver_prefill_ms": 143.16058298572898}, "total_wall_ms": 12329.695999971591, "ttft_ms": 13.415541965514421, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "549.950", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c32204796940cd9059911b0e83a82fefb88f14e6e434a96164278cc3586a0353", "output_hash": "cab784b9a3b9aa92b5218ac427b87c725bb99e22c3af34061c9cf715ac2eedec"} | ||||
| 1546 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e2cbea7f0cc29b66c0aaa799", "attempt_id": "5dbedd40409e", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:07.581130Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1304, "message_tokens": 1213, "message_utf8_bytes": 3040, "cache_tensor_bytes": null, "serialized_payload_bytes": 3040, "side_information_bytes": 0, "fetched_bytes": 1690, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12073.418041924015, "ttft_ms": 13.533500023186207, "decode_ms": 54.50850003398955, "receiver_prefill_ms": 140.57745796162635}, "total_wall_ms": 12284.050791990012, "ttft_ms": 13.533500023186207, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LN-61", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f5d3ba2174a7933770db075e755db772ac6db07dea7ffad7f17132b91092c6ad", "output_hash": "bd0c9af579a47956226f82ea004c3a4d7a6bcfa10004153a5143219fb282c26c"} | ||||
| 1547 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f4a33279ca4eb17ee6d5da29", "attempt_id": "17d120cad191", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:07.811498Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1311, "message_tokens": 1213, "message_utf8_bytes": 3040, "cache_tensor_bytes": null, "serialized_payload_bytes": 3040, "side_information_bytes": 0, "fetched_bytes": 1690, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12073.418041924015, "ttft_ms": 13.467582990415394, "decode_ms": 80.98425006028265, "receiver_prefill_ms": 140.87254100013524}, "total_wall_ms": 12310.869166860357, "ttft_ms": 13.467582990415394, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ad8be07e5b810377e6800b6c9786cc64b635c6a10a5541027f66ffcb67b88b41", "output_hash": "12747c557f66bc4ad85f9222ae86718a2c1a8fcfd94c6943ecda0388a8a62473"} | ||||
| 1548 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "27680b92686267fd08732c9c", "attempt_id": "11d9290972a9", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:08.066033Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1304, "message_tokens": 1213, "message_utf8_bytes": 3040, "cache_tensor_bytes": null, "serialized_payload_bytes": 3040, "side_information_bytes": 0, "fetched_bytes": 1690, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12073.418041924015, "ttft_ms": 13.292624964378774, "decode_ms": 95.05629097111523, "receiver_prefill_ms": 140.8732089912519}, "total_wall_ms": 12324.647166882642, "ttft_ms": 13.292624964378774, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "ad8be07e5b810377e6800b6c9786cc64b635c6a10a5541027f66ffcb67b88b41", "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1549 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "950b6b0c843d609b4b1bb3eb", "attempt_id": "6b4194376f6e", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:08.334905Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1301, "message_tokens": 1203, "message_utf8_bytes": 3041, "cache_tensor_bytes": null, "serialized_payload_bytes": 3041, "side_information_bytes": 0, "fetched_bytes": 1694, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12073.418041924015, "ttft_ms": 14.588250080123544, "decode_ms": 67.64995900448412, "receiver_prefill_ms": 140.38187498226762}, "total_wall_ms": 12298.478957964107, "ttft_ms": 14.588250080123544, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felard-13", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "806f885c7de2a1808b8f0b040599be99eae323449060b87b742b977ff684ac83", "output_hash": "3148a4375aedadf07a17298878dde115102f658fb7bebe944a013c9b53bec240"} | ||||
| 1550 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "edc0b1be7c9f7fa7c2c7e20d", "attempt_id": "e9b805025549", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:08.577401Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1322, "message_tokens": 1229, "message_utf8_bytes": 3083, "cache_tensor_bytes": null, "serialized_payload_bytes": 3083, "side_information_bytes": 0, "fetched_bytes": 1729, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12073.418041924015, "ttft_ms": 13.765249983407557, "decode_ms": 134.42337501328439, "receiver_prefill_ms": 143.2016659528017}, "total_wall_ms": 12366.888041840866, "ttft_ms": 13.765249983407557, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "33,378,635", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "c32204796940cd9059911b0e83a82fefb88f14e6e434a96164278cc3586a0353", "output_hash": "efb67ab407abdf4f461142e19cb21cb95eaf36d78f7ea473dcc3a5e6dcfc912e"} | ||||
| 1551 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6bac3997fe1f705049e79dbb", "attempt_id": "0ae48d7b5fcd", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:08.888223Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1306, "message_tokens": 1213, "message_utf8_bytes": 3040, "cache_tensor_bytes": null, "serialized_payload_bytes": 3040, "side_information_bytes": 0, "fetched_bytes": 1690, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12073.418041924015, "ttft_ms": 13.826625072397292, "decode_ms": 13.40545795392245, "receiver_prefill_ms": 140.46274998690933}, "total_wall_ms": 12243.150208843872, "ttft_ms": 13.826625072397292, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f5d3ba2174a7933770db075e755db772ac6db07dea7ffad7f17132b91092c6ad", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1552 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0ea656f271616a1bdcdaf0ab", "attempt_id": "c332b4b86be9", "run_group_id": "E5_core:shared_memory_A6|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:09.075180Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 2, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1308, "message_tokens": 1213, "message_utf8_bytes": 3040, "cache_tensor_bytes": null, "serialized_payload_bytes": 3040, "side_information_bytes": 0, "fetched_bytes": 1690, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 12073.418041924015, "ttft_ms": 13.667916995473206, "decode_ms": 13.608917011879385, "receiver_prefill_ms": 140.2309580007568}, "total_wall_ms": 12242.982750874944, "ttft_ms": 13.667916995473206, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f5d3ba2174a7933770db075e755db772ac6db07dea7ffad7f17132b91092c6ad", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1553 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "406e868916da7e7f0b8e1196", "attempt_id": "0f0b258d752b", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:10.002086Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230068224}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 30121, "cache_tensor_bytes": 230068224, "serialized_payload_bytes": 230068224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 739.9438340216875, "ttft_ms": 53.17895789630711, "decode_ms": 108.01137494854629, "receiver_prefill_ms": 0.0}, "total_wall_ms": 910.6197509681806, "ttft_ms": 53.17895789630711, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "549,950", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c186ae04f377e0a3f95a6b3affbd1003677f14085f9e34f17926f3b1d1a83d6a"} | ||||
| 1554 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5141a04d9dfff8ac67ae46e4", "attempt_id": "07548b8fdef8", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:10.190143Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230068224}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 45, "message_tokens": null, "message_utf8_bytes": 30121, "cache_tensor_bytes": 230068224, "serialized_payload_bytes": 230068224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 739.9438340216875, "ttft_ms": 47.442832961678505, "decode_ms": 150.01800004392862, "receiver_prefill_ms": 0.0}, "total_wall_ms": 944.9041261104867, "ttft_ms": 47.442832961678505, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PB-38S-9552", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "2ead15278e346194e16500a37d0e52a9739df0cf36c158fed043974d95161e89"} | ||||
| 1555 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "41f77c720100b784ca72c645", "attempt_id": "5a3a4cb9347c", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:10.412303Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230068224}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 52, "message_tokens": null, "message_utf8_bytes": 30121, "cache_tensor_bytes": 230068224, "serialized_payload_bytes": 230068224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 739.9438340216875, "ttft_ms": 47.251207986846566, "decode_ms": 120.6780830398202, "receiver_prefill_ms": 0.0}, "total_wall_ms": 915.571584017016, "ttft_ms": 47.251207986846566, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10066730", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "87519a500211c8cb5f53d6b4cda2cd518b18d757f7adef0e41cb4fe4f1ce9bb3"} | ||||
| 1556 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "fe9d5a5107112d50cbf8f6e6", "attempt_id": "90cc0af23d0e", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:10.605113Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230068224}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 45, "message_tokens": null, "message_utf8_bytes": 30121, "cache_tensor_bytes": 230068224, "serialized_payload_bytes": 230068224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 739.9438340216875, "ttft_ms": 46.87399999238551, "decode_ms": 104.96341693215072, "receiver_prefill_ms": 0.0}, "total_wall_ms": 899.2280840175226, "ttft_ms": 46.87399999238551, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1557 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d7bbe6e2f75a6328aa2c0293", "attempt_id": "b6c5e4040fe6", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:10.782210Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230068224}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 52, "message_tokens": null, "message_utf8_bytes": 30121, "cache_tensor_bytes": 230068224, "serialized_payload_bytes": 230068224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 739.9438340216875, "ttft_ms": 46.924500027671456, "decode_ms": 74.9058750225231, "receiver_prefill_ms": 0.0}, "total_wall_ms": 869.6087090065703, "ttft_ms": 46.924500027671456, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felard-13", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "3148a4375aedadf07a17298878dde115102f658fb7bebe944a013c9b53bec240"} | ||||
| 1558 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "33493e99c11456e6b8bbbe02", "attempt_id": "2c7b13c588f2", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:10.929357Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230068224}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30121, "cache_tensor_bytes": 230068224, "serialized_payload_bytes": 230068224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 739.9438340216875, "ttft_ms": 45.90945807285607, "decode_ms": 119.92999992799014, "receiver_prefill_ms": 0.0}, "total_wall_ms": 913.1274591200054, "ttft_ms": 45.90945807285607, "input_usage": {}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14639955", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c5633f58fba4e80c2230407774334bab5798fc116be8eb85f77902cff7f00c0c"} | ||||
| 1559 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "cb98c89526a7c964c2529c2b", "attempt_id": "6529dd68d0ac", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:11.120163Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230068224}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30121, "cache_tensor_bytes": 230068224, "serialized_payload_bytes": 230068224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 739.9438340216875, "ttft_ms": 45.78416596632451, "decode_ms": 14.98570793773979, "receiver_prefill_ms": 0.0}, "total_wall_ms": 808.1674589775503, "ttft_ms": 45.78416596632451, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1560 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "18c2fd6f3252f316fbe7ff35", "attempt_id": "62af46506132", "run_group_id": "E5_core:cache_concat_negative_control|k=2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:11.205530Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 2, "budget_tokens": 512, "cache_bytes": 230068224}, "question_access": "blind", "topology": "fanin_k2", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 30121, "cache_tensor_bytes": 230068224, "serialized_payload_bytes": 230068224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 739.9438340216875, "ttft_ms": 47.30895906686783, "decode_ms": 15.242750057950616, "receiver_prefill_ms": 0.0}, "total_wall_ms": 810.0527919596061, "ttft_ms": 47.30895906686783, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1561 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "68e16b868a8fca5c98f45431", "attempt_id": "eca64d427607", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:11.292807Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6363, "message_tokens": 6277, "message_utf8_bytes": 30651, "cache_tensor_bytes": null, "serialized_payload_bytes": 30651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.0314170029014349, "ttft_ms": 13.798166997730732, "decode_ms": 97.40820899605751, "receiver_prefill_ms": 742.2527919989079}, "total_wall_ms": 863.2012089947239, "ttft_ms": 13.798166997730732, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "549,950", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9395f0e47fc863280e77b9f57d6ff310ff74ff0f4a397f483b809756f2aee3a2", "output_hash": "c186ae04f377e0a3f95a6b3affbd1003677f14085f9e34f17926f3b1d1a83d6a"} | ||||
| 1562 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c8afec8f24ecc90d4a5b54e2", "attempt_id": "2c18ed011945", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:12.173004Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6364, "message_tokens": 6277, "message_utf8_bytes": 30651, "cache_tensor_bytes": null, "serialized_payload_bytes": 30651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.0314170029014349, "ttft_ms": 13.695958070456982, "decode_ms": 138.09312495868653, "receiver_prefill_ms": 743.1468750583008}, "total_wall_ms": 904.6748749678954, "ttft_ms": 13.695958070456982, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PB-38S-9552", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9395f0e47fc863280e77b9f57d6ff310ff74ff0f4a397f483b809756f2aee3a2", "output_hash": "2ead15278e346194e16500a37d0e52a9739df0cf36c158fed043974d95161e89"} | ||||
| 1563 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a1abaa66c9c3fe53954cd2da", "attempt_id": "bd33d2657af7", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:13.094676Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6371, "message_tokens": 6277, "message_utf8_bytes": 30651, "cache_tensor_bytes": null, "serialized_payload_bytes": 30651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.0314170029014349, "ttft_ms": 14.193541021086276, "decode_ms": 96.49883303791285, "receiver_prefill_ms": 758.2171249669045}, "total_wall_ms": 878.7434579571709, "ttft_ms": 14.193541021086276, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9395f0e47fc863280e77b9f57d6ff310ff74ff0f4a397f483b809756f2aee3a2", "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1564 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f0d2cd8c7fa52d0cdae8528e", "attempt_id": "c0ce2ad94d05", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:13.990550Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6364, "message_tokens": 6277, "message_utf8_bytes": 30651, "cache_tensor_bytes": null, "serialized_payload_bytes": 30651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.0314170029014349, "ttft_ms": 13.974832952953875, "decode_ms": 96.81954199913889, "receiver_prefill_ms": 758.3319169934839}, "total_wall_ms": 878.825583960861, "ttft_ms": 13.974832952953875, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9395f0e47fc863280e77b9f57d6ff310ff74ff0f4a397f483b809756f2aee3a2", "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1565 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c411f61cbef92836fd2fb62e", "attempt_id": "c125c7f7aa0d", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:14.886531Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6371, "message_tokens": 6277, "message_utf8_bytes": 30651, "cache_tensor_bytes": null, "serialized_payload_bytes": 30651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.0314170029014349, "ttft_ms": 14.021249953657389, "decode_ms": 56.06083304155618, "receiver_prefill_ms": 767.2095829620957}, "total_wall_ms": 846.9825000502169, "ttft_ms": 14.021249953657389, "input_usage": {}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Melqui-6", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9395f0e47fc863280e77b9f57d6ff310ff74ff0f4a397f483b809756f2aee3a2", "output_hash": "61840358f56e26ce55e72905cc4adc8d6434d4ed2c50a6b7dc75ccb1d7f170a7"} | ||||
| 1566 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "db77e13438d75ab69e60fe7e", "attempt_id": "efcebbceeebb", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:15.750524Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6366, "message_tokens": 6277, "message_utf8_bytes": 30651, "cache_tensor_bytes": null, "serialized_payload_bytes": 30651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.0314170029014349, "ttft_ms": 14.07766598276794, "decode_ms": 96.71724995132536, "receiver_prefill_ms": 778.0761249596253}, "total_wall_ms": 898.4904170501977, "ttft_ms": 14.07766598276794, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2078630", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9395f0e47fc863280e77b9f57d6ff310ff74ff0f4a397f483b809756f2aee3a2", "output_hash": "e5fde4cc33c7ffd0072366e9765ef0a40bb3e46e9c200fc683e5e000f2b9b1d9"} | ||||
| 1567 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "e63e2125c70b03813c4f3535", "attempt_id": "8862f33a3b8d", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:16.666129Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6366, "message_tokens": 6277, "message_utf8_bytes": 30651, "cache_tensor_bytes": null, "serialized_payload_bytes": 30651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.0314170029014349, "ttft_ms": 13.950834050774574, "decode_ms": 14.504291932098567, "receiver_prefill_ms": 775.7992499973625}, "total_wall_ms": 813.9300420880318, "ttft_ms": 13.950834050774574, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9395f0e47fc863280e77b9f57d6ff310ff74ff0f4a397f483b809756f2aee3a2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1568 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "08ee317ff29f048aa8b67d75", "attempt_id": "ce28a9d34bd2", "run_group_id": "E5_core:full_context|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:17.497287Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "full_context", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 6368, "message_tokens": 6277, "message_utf8_bytes": 30651, "cache_tensor_bytes": null, "serialized_payload_bytes": 30651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 0.0314170029014349, "ttft_ms": 14.36849997844547, "decode_ms": 13.920208089984953, "receiver_prefill_ms": 793.9879590412602}, "total_wall_ms": 832.614874932915, "ttft_ms": 14.36849997844547, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "9395f0e47fc863280e77b9f57d6ff310ff74ff0f4a397f483b809756f2aee3a2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1569 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "c087e6e252648c58962592ac", "attempt_id": "6ceee9b11076", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:42.859325Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1762}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1875, "message_tokens": 1787, "message_utf8_bytes": 5920, "cache_tensor_bytes": null, "serialized_payload_bytes": 5920, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 24512.284082942642, "ttft_ms": 13.988915947265923, "decode_ms": 94.08333303872496, "receiver_prefill_ms": 199.32395790237933}, "total_wall_ms": 24825.11054095812, "ttft_ms": 13.988915947265923, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "549,950", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a6baa180672517d3387c03555f603583cc2e64d5fbf191758d3b9d0015c17de", "output_hash": "c186ae04f377e0a3f95a6b3affbd1003677f14085f9e34f17926f3b1d1a83d6a"} | ||||
| 1570 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "dc0500c5d05793f50d053baa", "attempt_id": "128c22453c4f", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:43.190004Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1762}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1876, "message_tokens": 1787, "message_utf8_bytes": 5920, "cache_tensor_bytes": null, "serialized_payload_bytes": 5920, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 24512.284082942642, "ttft_ms": 13.369375024922192, "decode_ms": 134.03591699898243, "receiver_prefill_ms": 196.92879193462431}, "total_wall_ms": 24859.515166957863, "ttft_ms": 13.369375024922192, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PB-38S-9552", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a6baa180672517d3387c03555f603583cc2e64d5fbf191758d3b9d0015c17de", "output_hash": "2ead15278e346194e16500a37d0e52a9739df0cf36c158fed043974d95161e89"} | ||||
| 1571 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3c6b6a35a899fcc87558d43b", "attempt_id": "bc8ee2fd3f81", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:43.555144Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1762}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1883, "message_tokens": 1787, "message_utf8_bytes": 5920, "cache_tensor_bytes": null, "serialized_payload_bytes": 5920, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 24512.284082942642, "ttft_ms": 13.514750055037439, "decode_ms": 95.09966697078198, "receiver_prefill_ms": 198.33624991588295}, "total_wall_ms": 24822.131915949285, "ttft_ms": 13.514750055037439, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a6baa180672517d3387c03555f603583cc2e64d5fbf191758d3b9d0015c17de", "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1572 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ccc11dfb4b65e8f80b818c9c", "attempt_id": "cbfb5b00e86d", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:43.882256Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1762}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1876, "message_tokens": 1787, "message_utf8_bytes": 5920, "cache_tensor_bytes": null, "serialized_payload_bytes": 5920, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 24512.284082942642, "ttft_ms": 13.73370795045048, "decode_ms": 94.34133302420378, "receiver_prefill_ms": 196.6397080104798}, "total_wall_ms": 24819.95383289177, "ttft_ms": 13.73370795045048, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a6baa180672517d3387c03555f603583cc2e64d5fbf191758d3b9d0015c17de", "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1573 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "2582e812dae28081b0e90328", "attempt_id": "ff028894521a", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:44.207292Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1762}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1883, "message_tokens": 1787, "message_utf8_bytes": 5920, "cache_tensor_bytes": null, "serialized_payload_bytes": 5920, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 24512.284082942642, "ttft_ms": 13.600375037640333, "decode_ms": 66.94525002967566, "receiver_prefill_ms": 196.79137505590916}, "total_wall_ms": 24792.521332972683, "ttft_ms": 13.600375037640333, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felard-13", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a6baa180672517d3387c03555f603583cc2e64d5fbf191758d3b9d0015c17de", "output_hash": "3148a4375aedadf07a17298878dde115102f658fb7bebe944a013c9b53bec240"} | ||||
| 1574 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6384d3668e48f6db205805e9", "attempt_id": "f2a3cb9eac4c", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:44.504384Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1762}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1878, "message_tokens": 1787, "message_utf8_bytes": 5920, "cache_tensor_bytes": null, "serialized_payload_bytes": 5920, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 24512.284082942642, "ttft_ms": 13.596333097666502, "decode_ms": 94.27945804782212, "receiver_prefill_ms": 197.77337496634573}, "total_wall_ms": 24820.859457948245, "ttft_ms": 13.596333097666502, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2078630", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a6baa180672517d3387c03555f603583cc2e64d5fbf191758d3b9d0015c17de", "output_hash": "e5fde4cc33c7ffd0072366e9765ef0a40bb3e46e9c200fc683e5e000f2b9b1d9"} | ||||
| 1575 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "1d5c7333045fb38de5d7ad43", "attempt_id": "e4a1a5290205", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:44.830558Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1762}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1878, "message_tokens": 1787, "message_utf8_bytes": 5920, "cache_tensor_bytes": null, "serialized_payload_bytes": 5920, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 24512.284082942642, "ttft_ms": 13.563540996983647, "decode_ms": 13.718875008635223, "receiver_prefill_ms": 197.51125003676862}, "total_wall_ms": 24739.969624904916, "ttft_ms": 13.563540996983647, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a6baa180672517d3387c03555f603583cc2e64d5fbf191758d3b9d0015c17de", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1576 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ddfa166be5087afd591138c5", "attempt_id": "551c3c7849e6", "run_group_id": "E5_core:concat_A4|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:39:45.075870Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "concat_A4", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "sender_tokens": 1762}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1880, "message_tokens": 1787, "message_utf8_bytes": 5920, "cache_tensor_bytes": null, "serialized_payload_bytes": 5920, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 24512.284082942642, "ttft_ms": 13.536542071960866, "decode_ms": 13.679999974556267, "receiver_prefill_ms": 198.09850002638996}, "total_wall_ms": 24740.52137497347, "ttft_ms": 13.536542071960866, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "3a6baa180672517d3387c03555f603583cc2e64d5fbf191758d3b9d0015c17de", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1577 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f337086c2c2376c38f0e8259", "attempt_id": "71b844e7945f", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:12.339971Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 28}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1153, "message_tokens": 1062, "message_utf8_bytes": 2845, "cache_tensor_bytes": null, "serialized_payload_bytes": 2845, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27018.53129104711, "ttft_ms": 13.543708948418498, "decode_ms": 134.29783296305686, "receiver_prefill_ms": 120.90737500693649}, "total_wall_ms": 27289.453124045394, "ttft_ms": 13.543708948418498, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,449,570", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "39a2ba182ab21f882717e738a82f6ba212020f9947dbd37f38731c24c10ac079", "output_hash": "c9833e2549e9d7a4343060253f264e3a1297a6268cf257b4e393463606c03a67"} | ||||
| 1578 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "6841977c8ff77fc82dff9b74", "attempt_id": "5c770cf18f3b", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:12.628478Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 28}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1154, "message_tokens": 1062, "message_utf8_bytes": 2845, "cache_tensor_bytes": null, "serialized_payload_bytes": 2845, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27018.53129104711, "ttft_ms": 13.280375045724213, "decode_ms": 13.499707914888859, "receiver_prefill_ms": 124.89795801229775}, "total_wall_ms": 27171.977375051938, "ttft_ms": 13.280375045724213, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "39a2ba182ab21f882717e738a82f6ba212020f9947dbd37f38731c24c10ac079", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1579 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "567c31c7a8b400ce1da27ddf", "attempt_id": "de5411de7d31", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:12.799343Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 28}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1161, "message_tokens": 1062, "message_utf8_bytes": 2845, "cache_tensor_bytes": null, "serialized_payload_bytes": 2845, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27018.53129104711, "ttft_ms": 13.345542014576495, "decode_ms": 94.73200002685189, "receiver_prefill_ms": 124.6152090607211}, "total_wall_ms": 27253.01224901341, "ttft_ms": 13.345542014576495, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "603,595", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "39a2ba182ab21f882717e738a82f6ba212020f9947dbd37f38731c24c10ac079", "output_hash": "19f63ee7169f83e8e0256e7a4a4a68fa5980ea55ef086b8b373177c1d02539bc"} | ||||
| 1580 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "98924a078f4455df9de66a41", "attempt_id": "2453bc6a117c", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:13.050768Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 28}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1154, "message_tokens": 1062, "message_utf8_bytes": 2845, "cache_tensor_bytes": null, "serialized_payload_bytes": 2845, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27018.53129104711, "ttft_ms": 13.89287505298853, "decode_ms": 94.10933300387114, "receiver_prefill_ms": 124.52104093972594}, "total_wall_ms": 27252.86899902858, "ttft_ms": 13.89287505298853, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "603,595", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "39a2ba182ab21f882717e738a82f6ba212020f9947dbd37f38731c24c10ac079", "output_hash": "19f63ee7169f83e8e0256e7a4a4a68fa5980ea55ef086b8b373177c1d02539bc"} | ||||
| 1581 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a112c280e5114e105eeb14c7", "attempt_id": "3cc178b54e60", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:13.302235Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 28}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1161, "message_tokens": 1062, "message_utf8_bytes": 2845, "cache_tensor_bytes": null, "serialized_payload_bytes": 2845, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27018.53129104711, "ttft_ms": 13.450999977067113, "decode_ms": 67.16520909685642, "receiver_prefill_ms": 124.4415829423815}, "total_wall_ms": 27225.391415995546, "ttft_ms": 13.450999977067113, "input_usage": {}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felard-13", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "39a2ba182ab21f882717e738a82f6ba212020f9947dbd37f38731c24c10ac079", "output_hash": "3148a4375aedadf07a17298878dde115102f658fb7bebe944a013c9b53bec240"} | ||||
| 1582 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "97f47a2caa49c37505167144", "attempt_id": "c3139118cdad", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:13.526208Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 28}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1156, "message_tokens": 1062, "message_utf8_bytes": 2845, "cache_tensor_bytes": null, "serialized_payload_bytes": 2845, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27018.53129104711, "ttft_ms": 13.405250036157668, "decode_ms": 135.42233395855874, "receiver_prefill_ms": 124.59183298051357}, "total_wall_ms": 27293.784874025732, "ttft_ms": 13.405250036157668, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "19,923,050", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "39a2ba182ab21f882717e738a82f6ba212020f9947dbd37f38731c24c10ac079", "output_hash": "d706050bfa74746ba66037ff88a4427123260d07b98d81cd706dfa7924daf760"} | ||||
| 1583 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "aef952000804f790618939ae", "attempt_id": "da6185774924", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:13.818387Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 28}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1156, "message_tokens": 1062, "message_utf8_bytes": 2845, "cache_tensor_bytes": null, "serialized_payload_bytes": 2845, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27018.53129104711, "ttft_ms": 13.415624969638884, "decode_ms": 13.215875020250678, "receiver_prefill_ms": 124.38529194332659}, "total_wall_ms": 27171.371875097975, "ttft_ms": 13.415624969638884, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "39a2ba182ab21f882717e738a82f6ba212020f9947dbd37f38731c24c10ac079", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1584 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b18ff99713cc41911efb2a2f", "attempt_id": "65eb4faa8d7c", "run_group_id": "E5_core:merge_A5|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:13.988743Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "merge_A5", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512, "n_facts": 28}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 1158, "message_tokens": 1062, "message_utf8_bytes": 2845, "cache_tensor_bytes": null, "serialized_payload_bytes": 2845, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27018.53129104711, "ttft_ms": 13.709457940421999, "decode_ms": 13.340750010684133, "receiver_prefill_ms": 123.94762493204325}, "total_wall_ms": 27171.318166074343, "ttft_ms": 13.709457940421999, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "39a2ba182ab21f882717e738a82f6ba212020f9947dbd37f38731c24c10ac079", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1585 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d72a70a2442ec718ef65aba1", "attempt_id": "a5956edb7fec", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:41.178834Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 2480, "message_tokens": 2390, "message_utf8_bytes": 6201, "cache_tensor_bytes": null, "serialized_payload_bytes": 6201, "side_information_bytes": 0, "fetched_bytes": 3463, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27019.298290950246, "ttft_ms": 13.60095792915672, "decode_ms": 94.08470895141363, "receiver_prefill_ms": 269.93858302012086}, "total_wall_ms": 27400.42979095597, "ttft_ms": 13.60095792915672, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "549,950", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e48812b0e52a14584678a5ef8901a90987e9f7376fb95135534520d4dc118044", "output_hash": "c186ae04f377e0a3f95a6b3affbd1003677f14085f9e34f17926f3b1d1a83d6a"} | ||||
| 1586 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "3014259497547fe89e02f847", "attempt_id": "f3818dcbd0ba", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:41.578529Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 2390, "message_tokens": 2299, "message_utf8_bytes": 6053, "cache_tensor_bytes": null, "serialized_payload_bytes": 6053, "side_information_bytes": 0, "fetched_bytes": 3308, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27019.298290950246, "ttft_ms": 13.669458916410804, "decode_ms": 13.217000057920814, "receiver_prefill_ms": 261.5256670396775}, "total_wall_ms": 27310.906165861525, "ttft_ms": 13.669458916410804, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "b57e963d9ee3032d9548be162cab520604464e2d5920a60f692861386bb6c683", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1587 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "d6b4f9f8dc5113efdf583a92", "attempt_id": "ed094543fc6b", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:41.887311Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 2495, "message_tokens": 2397, "message_utf8_bytes": 6208, "cache_tensor_bytes": null, "serialized_payload_bytes": 6208, "side_information_bytes": 0, "fetched_bytes": 3475, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27019.298290950246, "ttft_ms": 14.207583968527615, "decode_ms": 80.65600006375462, "receiver_prefill_ms": 270.1085420558229}, "total_wall_ms": 27387.58566591423, "ttft_ms": 14.207583968527615, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "603595", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "315b048c483f1f009014b6f10859e7b1a2f6db01a90f97ee51828c882668ce86", "output_hash": "53938045cbda1d9b8c3cb9d7f21d792746e6f4eb283c76a564a5827bcf612f36"} | ||||
| 1588 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a185d4b0c563766327aa86f6", "attempt_id": "f2b9943ac1ff", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:42.273389Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 2488, "message_tokens": 2397, "message_utf8_bytes": 6208, "cache_tensor_bytes": null, "serialized_payload_bytes": 6208, "side_information_bytes": 0, "fetched_bytes": 3475, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27019.298290950246, "ttft_ms": 16.296333051286638, "decode_ms": 100.5012079840526, "receiver_prefill_ms": 851.8643750576302}, "total_wall_ms": 27991.24512495473, "ttft_ms": 16.296333051286638, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "315b048c483f1f009014b6f10859e7b1a2f6db01a90f97ee51828c882668ce86", "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1589 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "39ed4ad841ad8c0089f54b11", "attempt_id": "ee0cb20f76b1", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:43.262537Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 2417, "message_tokens": 2319, "message_utf8_bytes": 6068, "cache_tensor_bytes": null, "serialized_payload_bytes": 6068, "side_information_bytes": 0, "fetched_bytes": 3343, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27019.298290950246, "ttft_ms": 13.781124958768487, "decode_ms": 57.83987510949373, "receiver_prefill_ms": 403.3992920303717}, "total_wall_ms": 27498.364290921018, "ttft_ms": 13.781124958768487, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Melqui-6", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "f82de85d9ad467142b01f80cf1abfec7fcfa3fa7a6ad025700db125deaab8fa0", "output_hash": "61840358f56e26ce55e72905cc4adc8d6434d4ed2c50a6b7dc75ccb1d7f170a7"} | ||||
| 1590 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "022ffed3faa536d18816978c", "attempt_id": "e7f98c0237ae", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:43.760150Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 2490, "message_tokens": 2397, "message_utf8_bytes": 6208, "cache_tensor_bytes": null, "serialized_payload_bytes": 6208, "side_information_bytes": 0, "fetched_bytes": 3475, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27019.298290950246, "ttft_ms": 15.935500035993755, "decode_ms": 140.46895795036107, "receiver_prefill_ms": 439.2614579992369}, "total_wall_ms": 27618.92070795875, "ttft_ms": 15.935500035993755, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14,746,970", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "e5c8c0e54785dfa6a1b53477617587ceeb4b57258f5707e2e509fc119cd38015", "output_hash": "4cfc7c4f825e0611fa3e72f68f06189f1628ea428b25af07ca2d58df9b338b18"} | ||||
| 1591 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "5f20237aa6a660650ec64f1a", "attempt_id": "5d41f99a215c", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:44.380943Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 2450, "message_tokens": 2357, "message_utf8_bytes": 6185, "cache_tensor_bytes": null, "serialized_payload_bytes": 6185, "side_information_bytes": 0, "fetched_bytes": 3428, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27019.298290950246, "ttft_ms": 14.170125010423362, "decode_ms": 14.176459051668644, "receiver_prefill_ms": 710.57566604577}, "total_wall_ms": 27762.066790950485, "ttft_ms": 14.170125010423362, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "7914f67e882e4ab830dbc21801080520c8126fb7cbd4f63816e22dbb71623acf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1592 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "ec4719d50a05e6253f5ed106", "attempt_id": "5968768bb97e", "run_group_id": "E5_core:shared_memory_A6|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:45.144922Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "shared_memory_A6", "implementation_fidelity": "custom", "compression_config": {"k": 4, "budget_tokens": 512}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 2485, "message_tokens": 2390, "message_utf8_bytes": 6201, "cache_tensor_bytes": null, "serialized_payload_bytes": 6201, "side_information_bytes": 0, "fetched_bytes": 3463, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 27019.298290950246, "ttft_ms": 13.507750001735985, "decode_ms": 13.752833008766174, "receiver_prefill_ms": 273.8607919309288}, "total_wall_ms": 27323.836624855176, "ttft_ms": 13.507750001735985, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": "62b316f746c337a0792fff3a1edad2442e1cabcfccd41b937902db9218d5fc1f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1593 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "4c70e336b86732b4197abc89", "attempt_id": "c51862d51c22", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:46.272120Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237146112}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 44, "message_tokens": null, "message_utf8_bytes": 30597, "cache_tensor_bytes": 237146112, "serialized_payload_bytes": 237146112, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 802.392290905118, "ttft_ms": 53.18854202050716, "decode_ms": 110.97829206846654, "receiver_prefill_ms": 0.0}, "total_wall_ms": 973.416332853958, "ttft_ms": 53.18854202050716, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "549,950", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "c186ae04f377e0a3f95a6b3affbd1003677f14085f9e34f17926f3b1d1a83d6a"} | ||||
| 1594 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "82b9edd60c4b74186c1dd892", "attempt_id": "0a2d4cd2f8a5", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:46.465293Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237146112}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 45, "message_tokens": null, "message_utf8_bytes": 30597, "cache_tensor_bytes": 237146112, "serialized_payload_bytes": 237146112, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 802.392290905118, "ttft_ms": 50.113916979171336, "decode_ms": 155.98183393012732, "receiver_prefill_ms": 0.0}, "total_wall_ms": 1014.8744998732582, "ttft_ms": 50.113916979171336, "input_usage": {}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "multi_hop"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 1595 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "800cf664a102ea2aaa4b7a5a", "attempt_id": "964d2bdfa534", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:46.696386Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237146112}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 52, "message_tokens": null, "message_utf8_bytes": 30597, "cache_tensor_bytes": 237146112, "serialized_payload_bytes": 237146112, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 802.392290905118, "ttft_ms": 48.695583012886345, "decode_ms": 106.14445805549622, "receiver_prefill_ms": 0.0}, "total_wall_ms": 961.6976659744978, "ttft_ms": 48.695583012886345, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1596 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "992cf3c450e062b29a60ae36", "attempt_id": "5f6bf032113f", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:46.873662Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237146112}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 45, "message_tokens": null, "message_utf8_bytes": 30597, "cache_tensor_bytes": 237146112, "serialized_payload_bytes": 237146112, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 802.392290905118, "ttft_ms": 47.80549998395145, "decode_ms": 105.83745897747576, "receiver_prefill_ms": 0.0}, "total_wall_ms": 960.7046659803018, "ttft_ms": 47.80549998395145, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "497,425", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "revision"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "88a6c470039e48606cf3771bfcac5aa93ce7a2bdb9bded7ea7861cbc2208fe4a"} | ||||
| 1597 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "a4f137bbbb60f30ceca700d2", "attempt_id": "454458af4576", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:47.049942Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237146112}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 52, "message_tokens": null, "message_utf8_bytes": 30597, "cache_tensor_bytes": 237146112, "serialized_payload_bytes": 237146112, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 802.392290905118, "ttft_ms": 48.193832975812256, "decode_ms": 60.192666947841644, "receiver_prefill_ms": 0.0}, "total_wall_ms": 915.1852078502998, "ttft_ms": 48.193832975812256, "input_usage": {}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Melqui-6", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "temporal"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "61840358f56e26ce55e72905cc4adc8d6434d4ed2c50a6b7dc75ccb1d7f170a7"} | ||||
| 1598 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "b97676379c328d3e9263200a", "attempt_id": "4576e858096d", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:47.180560Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237146112}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30597, "cache_tensor_bytes": 237146112, "serialized_payload_bytes": 237146112, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 802.392290905118, "ttft_ms": 46.54445801861584, "decode_ms": 105.77791696414351, "receiver_prefill_ms": 0.0}, "total_wall_ms": 959.3425409402698, "ttft_ms": 46.54445801861584, "input_usage": {}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4971485", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "aggregation"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "705377d6f830799c0396bb6784962db0f5c886f2728dbe93c5e28fcce795de8b"} | ||||
| 1599 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "0f9f7f061c1452c4d6001c0b", "attempt_id": "fd3a43258a84", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:47.355687Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237146112}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 47, "message_tokens": null, "message_utf8_bytes": 30597, "cache_tensor_bytes": 237146112, "serialized_payload_bytes": 237146112, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 802.392290905118, "ttft_ms": 46.951958909630775, "decode_ms": 14.977624989114702, "receiver_prefill_ms": 0.0}, "total_wall_ms": 868.7634989619255, "ttft_ms": 46.951958909630775, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1600 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E5_core", "trial_id": "f6012e1462f97a453fc53086", "attempt_id": "d94386081d7a", "run_group_id": "E5_core:cache_concat_negative_control|k=4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "444d735820f61d067a2d894055dafbef3d1225fc66b0c2b7037d29704fbc1106", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:40:47.439618Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "cache_concat_negative_control", "implementation_fidelity": "n/a", "compression_config": {"k": 4, "budget_tokens": 512, "cache_bytes": 237146112}, "question_access": "blind", "topology": "fanin_k4", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5804, "query_tokens": 49, "message_tokens": null, "message_utf8_bytes": 30597, "cache_tensor_bytes": 237146112, "serialized_payload_bytes": 237146112, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"build_ms": 802.392290905118, "ttft_ms": 48.68395905941725, "decode_ms": 15.318875084631145, "receiver_prefill_ms": 0.0}, "total_wall_ms": 870.4206659458578, "ttft_ms": 48.68395905941725, "input_usage": {}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"conflict": {"code": "Felard-13", "bogus_amount": "4,709,045", "source": "S2"}, "question_type": "unanswerable"}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E5_core.log", "payload_hash": null, "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
added
runs/raw/chains/E4_core_syn_03021_2000_A4_closed_qwen3b_llama3b.json
+278 −0
@@ -0,0 +1,278 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702.\n\n- **Proposals under review**: Kovar-10, Selnov-10, Brilithko-20 (no attributes recorded).\n- **Kovar-9**:\n - Proposed by Kwame Varga on 1 May 2034.\n - Initial budget: 4,862,425 CAD.\n - Revised budget: 5,646,720 CAD.\n - Approved on 27 May 2034.\n - Site: Lot 536-R, Senneterre.\n - Supplier: MH-96F-2099.\n - Launch postponed to 14 January 2035.\n - Rated capacity: 22.3 MW.\n - Calibration constant: 21.4976.\n- **Selnov-7**:\n - Proposed by Yevgenia Rousseau on 16 March 2030.\n - Initial budget: 8,730,980 NOK.\n - Revised budget: 8,955,410 NOK.\n - Approved on 22 May 2030.\n - Site: Lot 938-B, Val-d'Or.\n - Supplier: UT-31L-8863.\n - Launch postponed to 4 March 2031.\n - Rated capacity: 46.93 t.\n - Calibration constant: 88.7751.\n- **Brilithko-17**:\n - Proposed by Casimir Delacroix on 26 August 2032.\n - Initial budget: 4,132,266 CAD.\n - Approved on 13 September 2032.\n - Site: Lot 778-T, Matagami.\n - Supplier: BQ-59Z-6753.\n - Launch postponed to 7 April 2033.\n - Rated capacity: 17.8 ha.\n - Calibration constant: 11.6076.\n- **Lithwensel-6**:\n - Proposed by Ingrid Mbeki on 19 November 2034.\n -", | ||||
| 4 | + "2": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702.\n\nProposals under review are Kovar-10, Selnov-10, and Brilithko-20. Details of Kovar-9, Selnov-7, Brilithko-17, and Lithwensel-6 are provided below.\n\nKovar-9:\n- Proposed by Kwame Varga on 1 May 2034.\n- Initial budget: 4,862,425 CAD.\n- Revised budget: 5,646,720 CAD.\n- Approved on 27 May 2034.\n- Site: Lot 536-R, Senneterre.\n- Supplier: MH-96F-2099.\n- Launch postponed to 14 January 2035.\n- Rated capacity: 22.3 MW.\n- Calibration constant: 21.4976.\n\nSelnov-7:\n- Proposed by Yevgenia Rousseau on 16 March 2030.\n- Initial budget: 8,730,980 NOK.\n- Revised budget: 8,955,410 NOK.\n- Approved on 22 May 2030.\n- Site: Lot 938-B, Val-d'Or.\n- Supplier: UT-31L-8863.\n- Launch postponed to 4 March 2031.\n- Rated capacity: 46.93 t.\n- Calibration constant: 88.7751.\n\nBrilithko-17:\n- Proposed by Casimir Delacroix on 26 August 2032.\n- Initial budget: 4,132,266 CAD.\n- Approved on 13 September 2032.\n- Site: Lot 778-T, Matagami.\n- Supplier: BQ-59Z-6753.\n- Launch postponed to 7 April 2033.\n- Rated capacity: 17.8 ha.\n- Calibration constant: 11.6076.\n\nLithwensel-6:\n- Proposed by Ingrid Mbeki on 19 November 2034.\n- No details recorded.", | ||||
| 5 | + "3": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702. Proposals under review are Kovar-10, Selnov-10, and Brilithko-20. Details for Kovar-9, Selnov-7, Brilithko-17, and Lithwensel-6 are provided below. Kovar-9: Proposed by Kwame Varga on 1 May 2034, initial budget 4,862,425 CAD, revised budget 5,646,720 CAD, approved 27 May 2034, site Lot 536-R, Senneterre, supplier MH-96F-2099, launch postponed to 14 January 2035, rated capacity 22.3 MW, calibration constant 21.4976. Selnov-7: Proposed by Yevgenia Rousseau on 16 March 2030, initial budget 8,730,980 NOK, revised budget 8,955,410 NOK, approved 22 May 2030, site Lot 938-B, Val-d'Or, supplier UT-31L-8863, launch postponed to 4 March 2031, rated capacity 46.93 t, calibration constant 88.7751. Brilithko-17: Proposed by Casimir Delacroix on 26 August 2032, initial budget 4,132,266 CAD, approved 13 September 2032, site Lot 778-T, Matagami, supplier BQ-59Z-6753, launch postponed to 7 April 2033, rated capacity 17.8 ha, calibration constant 11.6076. Lithwensel-6: Proposed by Ingrid Mbeki on 19 November 2034, no details recorded.", | ||||
| 6 | + "4": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702. Proposals under review are Kovar-10, Selnov-10, and Brilithko-20. Details for Kovar-9, Selnov-7, Brilithko-17, and Lithwensel-6 are provided below.\n\nKovar-9: Proposed by Kwame Varga on 1 May 2034, initial budget 4,862,425 CAD, revised budget 5,646,720 CAD, approved 27 May 2034. Site: Lot 536-R, Senneterre. Supplier: MH-96F-2099. Launch postponed to 14 January 2035. Rated capacity: 22.3 MW. Calibration constant: 21.4976.\n\nSelnov-7: Proposed by Yevgenia Rousseau on 16 March 2030, initial budget 8,730,980 NOK, revised budget 8,955,410 NOK, approved 22 May 2030. Site: Lot 938-B, Val-d'Or. Supplier: UT-31L-8863. Launch postponed to 4 March 2031. Rated capacity: 46.93 t. Calibration constant: 88.7751.\n\nBrilithko-17: Proposed by Casimir Delacroix on 26 August 2032, initial budget 4,132,266 CAD, approved 13 September 2032. Site: Lot 778-T, Matagami. Supplier: BQ-59Z-6753. Launch postponed to 7 April 2033. Rated capacity: 17.8 ha. Calibration constant: 11.6076.\n\nLithwensel-6: Proposed by Ingrid Mbeki on 19 November 2034, no details recorded.", | ||||
| 7 | + "5": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702. Proposals under review are Kovar-10, Selnov-10, and Brilithko-20. Details for Kovar-9, Selnov-7, Brilithko-17, and Lithwensel-6 are provided below.\n\nKovar-9: Proposed by Kwame Varga on 1 May 2034, initial budget 4,862,425 CAD, revised budget 5,646,720 CAD, approved 27 May 2034. Site: Lot 536-R, Senneterre. Supplier: MH-96F-2099. Launch postponed to 14 January 2035. Rated capacity: 22.3 MW. Calibration constant: 21.4976.\n\nSelnov-7: Proposed by Yevgenia Rousseau on 16 March 2030, initial budget 8,730,980 NOK, revised budget 8,955,410 NOK, approved 22 May 2030. Site: Lot 938-B, Val-d'Or. Supplier: UT-31L-8863. Launch postponed to 4 March 2031. Rated capacity: 46.93 t. Calibration constant: 88.7751.\n\nBrilithko-17: Proposed by Casimir Delacroix on 26 August 2032, initial budget 4,132,266 CAD, approved 13 September 2032. Site: Lot 778-T, Matagami. Supplier: BQ-59Z-6753. Launch postponed to 7 April 2033. Rated capacity: 17.8 ha. Calibration constant: 11.6076.\n\nLithwensel-6: Proposed by Ingrid Mbeki on 19 November 2034, no details recorded.", | ||||
| 8 | + "6": "Here is a faithful summary of the notes:\n\nINTERNAL LEDGER MEMO — Capital Projects Register, issue 702. Proposals under review are Kovar-10, Selnov-10, and Brilithko-20. Details for Kovar-9, Selnov-7, Brilithko-17, and Lithwensel-6 are provided below.\n\nKovar-9: Proposed by Kwame Varga on 1 May 2034, initial budget 4,862,425 CAD, revised budget 5,646,720 CAD, approved 27 May 2034. Site: Lot 536-R, Senneterre. Supplier: MH-96F-2099. Launch postponed to 14 January 2035. Rated capacity: 22.3 MW. Calibration constant: 21.4976.\n\nSelnov-7: Proposed by Yevgenia Rousseau on 16 March 2030, initial budget 8,730,980 NOK, revised budget 8,955,410 NOK, approved 22 May 2030. Site: Lot 938-B, Val-d'Or. Supplier: UT-31L-8863. Launch postponed to 4 March 2031. Rated capacity: 46.93 t. Calibration constant: 88.7751.\n\nBrilithko-17: Proposed by Casimir Delacroix on 26 August 2032, initial budget 4,132,266 CAD, approved 13 September 2032. Site: Lot 778-T, Matagami. Supplier: BQ-59Z-6753. Launch postponed to 7 April 2033. Rated capacity: 17.8 ha. Calibration constant: 11.6076.\n\nLithwensel-6: Proposed by Ingrid Mbeki on 19 November 2034, no details recorded.", | ||||
| 9 | + "7": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702. Proposals under review are Kovar-10, Selnov-10, and Brilithko-20. Details for Kovar-9, Selnov-7, Brilithko-17, and Lithwensel-6 are provided below.\n\nKovar-9: Proposed by Kwame Varga on 1 May 2034, initial budget 4,862,425 CAD, revised budget 5,646,720 CAD, approved 27 May 2034. Site: Lot 536-R, Senneterre. Supplier: MH-96F-2099. Launch postponed to 14 January 2035. Rated capacity: 22.3 MW. Calibration constant: 21.4976.\n\nSelnov-7: Proposed by Yevgenia Rousseau on 16 March 2030, initial budget 8,730,980 NOK, revised budget 8,955,410 NOK, approved 22 May 2030. Site: Lot 938-B, Val-d'Or. Supplier: UT-31L-8863. Launch postponed to 4 March 2031. Rated capacity: 46.93 t. Calibration constant: 88.7751.\n\nBrilithko-17: Proposed by Casimir Delacroix on 26 August 2032, initial budget 4,132,266 CAD, approved 13 September 2032. Site: Lot 778-T, Matagami. Supplier: BQ-59Z-6753. Launch postponed to 7 April 2033. Rated capacity: 17.8 ha. Calibration constant: 11.6076.\n\nLithwensel-6: Proposed by Ingrid Mbeki on 19 November 2034, no details recorded.", | ||||
| 10 | + "8": "Here is a faithful summary of the notes:\n\nINTERNAL LEDGER MEMO — Capital Projects Register, issue 702. Proposals under review are Kovar-10, Selnov-10, and Brilithko-20. Details for Kovar-9, Selnov-7, Brilithko-17, and Lithwensel-6 are provided below.\n\nKovar-9: Proposed by Kwame Varga on 1 May 2034, initial budget 4,862,425 CAD, revised budget 5,646,720 CAD, approved 27 May 2034. Site: Lot 536-R, Senneterre. Supplier: MH-96F-2099. Launch postponed to 14 January 2035. Rated capacity: 22.3 MW. Calibration constant: 21.4976.\n\nSelnov-7: Proposed by Yevgenia Rousseau on 16 March 2030, initial budget 8,730,980 NOK, revised budget 8,955,410 NOK, approved 22 May 2030. Site: Lot 938-B, Val-d'Or. Supplier: UT-31L-8863. Launch postponed to 4 March 2031. Rated capacity: 46.93 t. Calibration constant: 88.7751.\n\nBrilithko-17: Proposed by Casimir Delacroix on 26 August 2032, initial budget 4,132,266 CAD, approved 13 September 2032. Site: Lot 778-T, Matagami. Supplier: BQ-59Z-6753. Launch postponed to 7 April 2033. Rated capacity: 17.8 ha. Calibration constant: 11.6076.\n\nLithwensel-6: Proposed by Ingrid Mbeki on 19 November 2034, no details recorded." | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 22361.685457988642, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2030, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 994.1834170604125, | ||||
| 20 | + "sender_ttft_ms": 59.90279105026275, | ||||
| 21 | + "sender_decode_ms": 21305.44970894698 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 65, | ||||
| 29 | + "facts_retained": 38, | ||||
| 30 | + "retention_rate": 0.5846153846153846, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.8333333333333334, | ||||
| 33 | + "date": 0.7, | ||||
| 34 | + "amount": 0.38461538461538464, | ||||
| 35 | + "status": 1.0, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.5, | ||||
| 38 | + "quantity": 0.5 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 1179 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 5128.560750046745, | ||||
| 48 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 567, | ||||
| 51 | + "sender_output_tokens": 421, | ||||
| 52 | + "sender_prefill_ms": 218.38420908898115, | ||||
| 53 | + "sender_ttft_ms": 11.756957974284887, | ||||
| 54 | + "sender_decode_ms": 4897.566792089492 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 0, | ||||
| 58 | + "fetched_bytes": 0 | ||||
| 59 | + }, | ||||
| 60 | + "ledger": { | ||||
| 61 | + "facts_total": 65, | ||||
| 62 | + "facts_retained": 38, | ||||
| 63 | + "retention_rate": 0.5846153846153846, | ||||
| 64 | + "retention_by_kind": { | ||||
| 65 | + "person": 0.8333333333333334, | ||||
| 66 | + "date": 0.7, | ||||
| 67 | + "amount": 0.38461538461538464, | ||||
| 68 | + "status": 1.0, | ||||
| 69 | + "place": 0.0, | ||||
| 70 | + "identifier": 0.5, | ||||
| 71 | + "quantity": 0.5 | ||||
| 72 | + }, | ||||
| 73 | + "unsupported_numbers": 0, | ||||
| 74 | + "unsupported_identifiers": 0, | ||||
| 75 | + "distorted_sentences": 0, | ||||
| 76 | + "message_bytes": 1181 | ||||
| 77 | + } | ||||
| 78 | + }, | ||||
| 79 | + "3": { | ||||
| 80 | + "hop_ms": 5686.298708082177, | ||||
| 81 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 82 | + "usage": { | ||||
| 83 | + "sender_input_tokens": 619, | ||||
| 84 | + "sender_output_tokens": 453, | ||||
| 85 | + "sender_prefill_ms": 234.762541949749, | ||||
| 86 | + "sender_ttft_ms": 12.249166029505432, | ||||
| 87 | + "sender_decode_ms": 5438.4718330111355 | ||||
| 88 | + }, | ||||
| 89 | + "repair": { | ||||
| 90 | + "lookups": 0, | ||||
| 91 | + "fetched_bytes": 0 | ||||
| 92 | + }, | ||||
| 93 | + "ledger": { | ||||
| 94 | + "facts_total": 65, | ||||
| 95 | + "facts_retained": 38, | ||||
| 96 | + "retention_rate": 0.5846153846153846, | ||||
| 97 | + "retention_by_kind": { | ||||
| 98 | + "person": 0.8333333333333334, | ||||
| 99 | + "date": 0.7, | ||||
| 100 | + "amount": 0.38461538461538464, | ||||
| 101 | + "status": 1.0, | ||||
| 102 | + "place": 0.0, | ||||
| 103 | + "identifier": 0.5, | ||||
| 104 | + "quantity": 0.5 | ||||
| 105 | + }, | ||||
| 106 | + "unsupported_numbers": 0, | ||||
| 107 | + "unsupported_identifiers": 0, | ||||
| 108 | + "distorted_sentences": 0, | ||||
| 109 | + "message_bytes": 1095 | ||||
| 110 | + } | ||||
| 111 | + }, | ||||
| 112 | + "4": { | ||||
| 113 | + "hop_ms": 4692.91458290536, | ||||
| 114 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 115 | + "usage": { | ||||
| 116 | + "sender_input_tokens": 507, | ||||
| 117 | + "sender_output_tokens": 385, | ||||
| 118 | + "sender_prefill_ms": 217.26862504146993, | ||||
| 119 | + "sender_ttft_ms": 11.63408299908042, | ||||
| 120 | + "sender_decode_ms": 4463.197874953039 | ||||
| 121 | + }, | ||||
| 122 | + "repair": { | ||||
| 123 | + "lookups": 0, | ||||
| 124 | + "fetched_bytes": 0 | ||||
| 125 | + }, | ||||
| 126 | + "ledger": { | ||||
| 127 | + "facts_total": 65, | ||||
| 128 | + "facts_retained": 38, | ||||
| 129 | + "retention_rate": 0.5846153846153846, | ||||
| 130 | + "retention_by_kind": { | ||||
| 131 | + "person": 0.8333333333333334, | ||||
| 132 | + "date": 0.7, | ||||
| 133 | + "amount": 0.38461538461538464, | ||||
| 134 | + "status": 1.0, | ||||
| 135 | + "place": 0.0, | ||||
| 136 | + "identifier": 0.5, | ||||
| 137 | + "quantity": 0.5 | ||||
| 138 | + }, | ||||
| 139 | + "unsupported_numbers": 0, | ||||
| 140 | + "unsupported_identifiers": 0, | ||||
| 141 | + "distorted_sentences": 0, | ||||
| 142 | + "message_bytes": 1111 | ||||
| 143 | + } | ||||
| 144 | + }, | ||||
| 145 | + "5": { | ||||
| 146 | + "hop_ms": 5842.431625002064, | ||||
| 147 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 148 | + "usage": { | ||||
| 149 | + "sender_input_tokens": 583, | ||||
| 150 | + "sender_output_tokens": 467, | ||||
| 151 | + "sender_prefill_ms": 230.9680419275537, | ||||
| 152 | + "sender_ttft_ms": 12.078708037734032, | ||||
| 153 | + "sender_decode_ms": 5598.6102080205455 | ||||
| 154 | + }, | ||||
| 155 | + "repair": { | ||||
| 156 | + "lookups": 0, | ||||
| 157 | + "fetched_bytes": 0 | ||||
| 158 | + }, | ||||
| 159 | + "ledger": { | ||||
| 160 | + "facts_total": 65, | ||||
| 161 | + "facts_retained": 38, | ||||
| 162 | + "retention_rate": 0.5846153846153846, | ||||
| 163 | + "retention_by_kind": { | ||||
| 164 | + "person": 0.8333333333333334, | ||||
| 165 | + "date": 0.7, | ||||
| 166 | + "amount": 0.38461538461538464, | ||||
| 167 | + "status": 1.0, | ||||
| 168 | + "place": 0.0, | ||||
| 169 | + "identifier": 0.5, | ||||
| 170 | + "quantity": 0.5 | ||||
| 171 | + }, | ||||
| 172 | + "unsupported_numbers": 0, | ||||
| 173 | + "unsupported_identifiers": 0, | ||||
| 174 | + "distorted_sentences": 0, | ||||
| 175 | + "message_bytes": 1111 | ||||
| 176 | + } | ||||
| 177 | + }, | ||||
| 178 | + "6": { | ||||
| 179 | + "hop_ms": 4801.743416930549, | ||||
| 180 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 181 | + "usage": { | ||||
| 182 | + "sender_input_tokens": 521, | ||||
| 183 | + "sender_output_tokens": 394, | ||||
| 184 | + "sender_prefill_ms": 215.6820420641452, | ||||
| 185 | + "sender_ttft_ms": 11.683208984322846, | ||||
| 186 | + "sender_decode_ms": 4573.550250031985 | ||||
| 187 | + }, | ||||
| 188 | + "repair": { | ||||
| 189 | + "lookups": 0, | ||||
| 190 | + "fetched_bytes": 0 | ||||
| 191 | + }, | ||||
| 192 | + "ledger": { | ||||
| 193 | + "facts_total": 65, | ||||
| 194 | + "facts_retained": 38, | ||||
| 195 | + "retention_rate": 0.5846153846153846, | ||||
| 196 | + "retention_by_kind": { | ||||
| 197 | + "person": 0.8333333333333334, | ||||
| 198 | + "date": 0.7, | ||||
| 199 | + "amount": 0.38461538461538464, | ||||
| 200 | + "status": 1.0, | ||||
| 201 | + "place": 0.0, | ||||
| 202 | + "identifier": 0.5, | ||||
| 203 | + "quantity": 0.5 | ||||
| 204 | + }, | ||||
| 205 | + "unsupported_numbers": 0, | ||||
| 206 | + "unsupported_identifiers": 0, | ||||
| 207 | + "distorted_sentences": 0, | ||||
| 208 | + "message_bytes": 1153 | ||||
| 209 | + } | ||||
| 210 | + }, | ||||
| 211 | + "7": { | ||||
| 212 | + "hop_ms": 5841.1449999548495, | ||||
| 213 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 214 | + "usage": { | ||||
| 215 | + "sender_input_tokens": 592, | ||||
| 216 | + "sender_output_tokens": 467, | ||||
| 217 | + "sender_prefill_ms": 232.78454097453505, | ||||
| 218 | + "sender_ttft_ms": 12.07845809403807, | ||||
| 219 | + "sender_decode_ms": 5595.478917006403 | ||||
| 220 | + }, | ||||
| 221 | + "repair": { | ||||
| 222 | + "lookups": 0, | ||||
| 223 | + "fetched_bytes": 0 | ||||
| 224 | + }, | ||||
| 225 | + "ledger": { | ||||
| 226 | + "facts_total": 65, | ||||
| 227 | + "facts_retained": 38, | ||||
| 228 | + "retention_rate": 0.5846153846153846, | ||||
| 229 | + "retention_by_kind": { | ||||
| 230 | + "person": 0.8333333333333334, | ||||
| 231 | + "date": 0.7, | ||||
| 232 | + "amount": 0.38461538461538464, | ||||
| 233 | + "status": 1.0, | ||||
| 234 | + "place": 0.0, | ||||
| 235 | + "identifier": 0.5, | ||||
| 236 | + "quantity": 0.5 | ||||
| 237 | + }, | ||||
| 238 | + "unsupported_numbers": 0, | ||||
| 239 | + "unsupported_identifiers": 0, | ||||
| 240 | + "distorted_sentences": 0, | ||||
| 241 | + "message_bytes": 1111 | ||||
| 242 | + } | ||||
| 243 | + }, | ||||
| 244 | + "8": { | ||||
| 245 | + "hop_ms": 4797.338917036541, | ||||
| 246 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 247 | + "usage": { | ||||
| 248 | + "sender_input_tokens": 521, | ||||
| 249 | + "sender_output_tokens": 394, | ||||
| 250 | + "sender_prefill_ms": 215.26183292735368, | ||||
| 251 | + "sender_ttft_ms": 11.767500080168247, | ||||
| 252 | + "sender_decode_ms": 4569.510750006884 | ||||
| 253 | + }, | ||||
| 254 | + "repair": { | ||||
| 255 | + "lookups": 0, | ||||
| 256 | + "fetched_bytes": 0 | ||||
| 257 | + }, | ||||
| 258 | + "ledger": { | ||||
| 259 | + "facts_total": 65, | ||||
| 260 | + "facts_retained": 38, | ||||
| 261 | + "retention_rate": 0.5846153846153846, | ||||
| 262 | + "retention_by_kind": { | ||||
| 263 | + "person": 0.8333333333333334, | ||||
| 264 | + "date": 0.7, | ||||
| 265 | + "amount": 0.38461538461538464, | ||||
| 266 | + "status": 1.0, | ||||
| 267 | + "place": 0.0, | ||||
| 268 | + "identifier": 0.5, | ||||
| 269 | + "quantity": 0.5 | ||||
| 270 | + }, | ||||
| 271 | + "unsupported_numbers": 0, | ||||
| 272 | + "unsupported_identifiers": 0, | ||||
| 273 | + "distorted_sentences": 0, | ||||
| 274 | + "message_bytes": 1153 | ||||
| 275 | + } | ||||
| 276 | + } | ||||
| 277 | + } | ||||
| 278 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03021_2000_A4_repairable_qwen3b.json
+285 −0
@@ -0,0 +1,285 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702.\n\n- **Proposals under review**: Kovar-10, Selnov-10, Brilithko-20 (no attributes recorded).\n- **Kovar-9**:\n - Proposed by Kwame Varga on 1 May 2034.\n - Initial budget: 4,862,425 CAD.\n - Revised budget: 5,646,720 CAD.\n - Approved on 27 May 2034.\n - Site: Lot 536-R, Senneterre.\n - Supplier: MH-96F-2099.\n - Launch postponed to 14 January 2035.\n - Rated capacity: 22.3 MW.\n - Calibration constant: 21.4976.\n- **Selnov-7**:\n - Proposed by Yevgenia Rousseau on 16 March 2030.\n - Initial budget: 8,730,980 NOK.\n - Revised budget: 8,955,410 NOK.\n - Approved on 22 May 2030.\n - Site: Lot 938-B, Val-d'Or.\n - Supplier: UT-31L-8863.\n - Launch postponed to 4 March 2031.\n - Rated capacity: 46.93 t.\n - Calibration constant: 88.7751.\n- **Brilithko-17**:\n - Proposed by Casimir Delacroix on 26 August 2032.\n - Initial budget: 4,132,266 CAD.\n - Approved on 13 September 2032.\n - Site: Lot 778-T, Matagami.\n - Supplier: BQ-59Z-6753.\n - Launch postponed to 7 April 2033.\n - Rated capacity: 17.8 ha.\n - Calibration constant: 11.6076.\n- **Lithwensel-6**:\n - Proposed by Ingrid Mbeki on 19 November 2034.\n -", | ||||
| 4 | + "2": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702.\n\n- **Proposals under review**: Kovar-10, Selnov-10, Brilithko-20 (no attributes recorded).\n- **Kovar-9**:\n - Proposed by Kwame Varga on 1 May 2034.\n - Initial budget: 4,862,425 CAD.\n - Revised budget: 5,646,720 CAD.\n - Approved on 27 May 2034.\n - Site: Lot 536-R, Senneterre.\n - Supplier: MH-96F-2099.\n - Launch postponed to 14 January 2035.\n - Rated capacity: 22.3 MW.\n - Calibration constant: 21.4976.\n- **Selnov-7**:\n - Proposed by Yevgenia Rousseau on 16 March 2030.\n - Initial budget: 8,730,980 NOK.\n - Revised budget: 8,955,410 NOK.\n - Approved on 22 May 2030.\n - Site: Lot 938-B, Val-d'Or.\n - Supplier: UT-31L-8863.\n - Launch postponed to 4 March 2031.\n - Rated capacity: 46.93 t.\n - Calibration constant: 88.7751.\n- **Brilithko-17**:\n - Proposed by Casimir Delacroix on 26 August 2032.\n - Initial budget: 4,132,266 CAD.\n - Approved on 13 September 2032.\n - Site: Lot 778-T, Matagami.\n - Supplier: BQ-59Z-6753.\n - Launch postponed to 7 April 2033.\n - Rated capacity: 17.8 ha.\n - Calibration constant: 11.6076.\n- **Lithwensel-6**:\n (No attributes recorded)", | ||||
| 5 | + "3": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702.\n\n- **Proposals under review**: Kovar-10, Selnov-10, Brilithko-20 (no attributes recorded).\n- **Kovar-9**:\n - Proposed by Kwame Varga on 1 May 2034.\n - Initial budget: 4,862,425 CAD.\n - Revised budget: 5,646,720 CAD.\n - Approved on 27 May 2034.\n - Site: Lot 536-R, Senneterre.\n - Supplier: MH-96F-2099.\n - Launch postponed to 14 January 2035.\n - Rated capacity: 22.3 MW.\n - Calibration constant: 21.4976.\n- **Selnov-7**:\n - Proposed by Yevgenia Rousseau on 16 March 2030.\n - Initial budget: 8,730,980 NOK.\n - Revised budget: 8,955,410 NOK.\n - Approved on 22 May 2030.\n - Site: Lot 938-B, Val-d'Or.\n - Supplier: UT-31L-8863.\n - Launch postponed to 4 March 2031.\n - Rated capacity: 46.93 t.\n - Calibration constant: 88.7751.\n- **Brilithko-17**:\n - Proposed by Casimir Delacroix on 26 August 2032.\n - Initial budget: 4,132,266 CAD.\n - Approved on 13 September 2032.\n - Site: Lot 778-T, Matagami.\n - Supplier: BQ-59Z-6753.\n - Launch postponed to 7 April 2033.\n - Rated capacity: 17.8 ha.\n - Calibration constant: 11.6076.\n- **Lithwensel-6**:\n (No attributes recorded)", | ||||
| 6 | + "4": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702.\n\n- **Proposals under review**: Kovar-10, Selnov-10, Brilithko-20 (no attributes recorded).\n- **Kovar-9**:\n - Proposed by Kwame Varga on 1 May 2034.\n - Initial budget: 4,862,425 CAD.\n - Revised budget: 5,646,720 CAD.\n - Approved on 27 May 2034.\n - Site: Lot 536-R, Senneterre.\n - Supplier: MH-96F-2099.\n - Launch postponed to 14 January 2035.\n - Rated capacity: 22.3 MW.\n - Calibration constant: 21.4976.\n- **Selnov-7**:\n - Proposed by Yevgenia Rousseau on 16 March 2030.\n - Initial budget: 8,730,980 NOK.\n - Revised budget: 8,955,410 NOK.\n - Approved on 22 May 2030.\n - Site: Lot 938-B, Val-d'Or.\n - Supplier: UT-31L-8863.\n - Launch postponed to 4 March 2031.\n - Rated capacity: 46.93 t.\n - Calibration constant: 88.7751.\n- **Brilithko-17**:\n - Proposed by Casimir Delacroix on 26 August 2032.\n - Initial budget: 4,132,266 CAD.\n - Approved on 13 September 2032.\n - Site: Lot 778-T, Matagami.\n - Supplier: BQ-59Z-6753.\n - Launch postponed to 7 April 2033.\n - Rated capacity: 17.8 ha.\n - Calibration constant: 11.6076.\n- **Lithwensel-6**:\n (No attributes recorded)", | ||||
| 7 | + "5": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702.\n\n- **Proposals under review**: Kovar-10, Selnov-10, Brilithko-20 (no attributes recorded).\n- **Kovar-9**:\n - Proposed by Kwame Varga on 1 May 2034.\n - Initial budget: 4,862,425 CAD.\n - Revised budget: 5,646,720 CAD.\n - Approved on 27 May 2034.\n - Site: Lot 536-R, Senneterre.\n - Supplier: MH-96F-2099.\n - Launch postponed to 14 January 2035.\n - Rated capacity: 22.3 MW.\n - Calibration constant: 21.4976.\n- **Selnov-7**:\n - Proposed by Yevgenia Rousseau on 16 March 2030.\n - Initial budget: 8,730,980 NOK.\n - Revised budget: 8,955,410 NOK.\n - Approved on 22 May 2030.\n - Site: Lot 938-B, Val-d'Or.\n - Supplier: UT-31L-8863.\n - Launch postponed to 4 March 2031.\n - Rated capacity: 46.93 t.\n - Calibration constant: 88.7751.\n- **Brilithko-17**:\n - Proposed by Casimir Delacroix on 26 August 2032.\n - Initial budget: 4,132,266 CAD.\n - Approved on 13 September 2032.\n - Site: Lot 778-T, Matagami.\n - Supplier: BQ-59Z-6753.\n - Launch postponed to 7 April 2033.\n - Rated capacity: 17.8 ha.\n - Calibration constant: 11.6076.\n- **Lithwensel-6**:\n (No attributes recorded)", | ||||
| 8 | + "6": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702.\n\n- **Proposals under review**: Kovar-10, Selnov-10, Brilithko-20 (no attributes recorded).\n- **Kovar-9**:\n - Proposed by Kwame Varga on 1 May 2034.\n - Initial budget: 4,862,425 CAD.\n - Revised budget: 5,646,720 CAD.\n - Approved on 27 May 2034.\n - Site: Lot 536-R, Senneterre.\n - Supplier: MH-96F-2099.\n - Launch postponed to 14 January 2035.\n - Rated capacity: 22.3 MW.\n - Calibration constant: 21.4976.\n- **Selnov-7**:\n - Proposed by Yevgenia Rousseau on 16 March 2030.\n - Initial budget: 8,730,980 NOK.\n - Revised budget: 8,955,410 NOK.\n - Approved on 22 May 2030.\n - Site: Lot 938-B, Val-d'Or.\n - Supplier: UT-31L-8863.\n - Launch postponed to 4 March 2031.\n - Rated capacity: 46.93 t.\n - Calibration constant: 88.7751.\n- **Brilithko-17**:\n - Proposed by Casimir Delacroix on 26 August 2032.\n - Initial budget: 4,132,266 CAD.\n - Approved on 13 September 2032.\n - Site: Lot 778-T, Matagami.\n - Supplier: BQ-59Z-6753.\n - Launch postponed to 7 April 2033.\n - Rated capacity: 17.8 ha.\n - Calibration constant: 11.6076.\n- **Lithwensel-6**:\n (No attributes recorded)", | ||||
| 9 | + "7": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702.\n\n- **Proposals under review**: Kovar-10, Selnov-10, Brilithko-20 (no attributes recorded).\n- **Kovar-9**:\n - Proposed by Kwame Varga on 1 May 2034.\n - Initial budget: 4,862,425 CAD.\n - Revised budget: 5,646,720 CAD.\n - Approved on 27 May 2034.\n - Site: Lot 536-R, Senneterre.\n - Supplier: MH-96F-2099.\n - Launch postponed to 14 January 2035.\n - Rated capacity: 22.3 MW.\n - Calibration constant: 21.4976.\n- **Selnov-7**:\n - Proposed by Yevgenia Rousseau on 16 March 2030.\n - Initial budget: 8,730,980 NOK.\n - Revised budget: 8,955,410 NOK.\n - Approved on 22 May 2030.\n - Site: Lot 938-B, Val-d'Or.\n - Supplier: UT-31L-8863.\n - Launch postponed to 4 March 2031.\n - Rated capacity: 46.93 t.\n - Calibration constant: 88.7751.\n- **Brilithko-17**:\n - Proposed by Casimir Delacroix on 26 August 2032.\n - Initial budget: 4,132,266 CAD.\n - Approved on 13 September 2032.\n - Site: Lot 778-T, Matagami.\n - Supplier: BQ-59Z-6753.\n - Launch postponed to 7 April 2033.\n - Rated capacity: 17.8 ha.\n - Calibration constant: 11.6076.\n- **Lithwensel-6**:\n (No attributes recorded)", | ||||
| 10 | + "8": "INTERNAL LEDGER MEMO — Capital Projects Register, issue 702.\n\n- **Proposals under review**: Kovar-10, Selnov-10, Brilithko-20 (no attributes recorded).\n- **Kovar-9**:\n - Proposed by Kwame Varga on 1 May 2034.\n - Initial budget: 4,862,425 CAD.\n - Revised budget: 5,646,720 CAD.\n - Approved on 27 May 2034.\n - Site: Lot 536-R, Senneterre.\n - Supplier: MH-96F-2099.\n - Launch postponed to 14 January 2035.\n - Rated capacity: 22.3 MW.\n - Calibration constant: 21.4976.\n- **Selnov-7**:\n - Proposed by Yevgenia Rousseau on 16 March 2030.\n - Initial budget: 8,730,980 NOK.\n - Revised budget: 8,955,410 NOK.\n - Approved on 22 May 2030.\n - Site: Lot 938-B, Val-d'Or.\n - Supplier: UT-31L-8863.\n - Launch postponed to 4 March 2031.\n - Rated capacity: 46.93 t.\n - Calibration constant: 88.7751.\n- **Brilithko-17**:\n - Proposed by Casimir Delacroix on 26 August 2032.\n - Initial budget: 4,132,266 CAD.\n - Approved on 13 September 2032.\n - Site: Lot 778-T, Matagami.\n - Supplier: BQ-59Z-6753.\n - Launch postponed to 7 April 2033.\n - Rated capacity: 17.8 ha.\n - Calibration constant: 11.6076.\n- **Lithwensel-6**:\n (No attributes recorded)" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6860.111457994208, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2030, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 693.2174999965355, | ||||
| 20 | + "sender_ttft_ms": 12.207207968458533, | ||||
| 21 | + "sender_decode_ms": 6152.579875080846 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 65, | ||||
| 29 | + "facts_retained": 38, | ||||
| 30 | + "retention_rate": 0.5846153846153846, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.8333333333333334, | ||||
| 33 | + "date": 0.7, | ||||
| 34 | + "amount": 0.38461538461538464, | ||||
| 35 | + "status": 1.0, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.5, | ||||
| 38 | + "quantity": 0.5 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 1179 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 6301.548000075854, | ||||
| 48 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 958, | ||||
| 51 | + "sender_output_tokens": 497, | ||||
| 52 | + "sender_prefill_ms": 339.87254195380956, | ||||
| 53 | + "sender_ttft_ms": 12.259791023097932, | ||||
| 54 | + "sender_decode_ms": 5948.388541932218 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 4, | ||||
| 58 | + "fetched_bytes": 746, | ||||
| 59 | + "codes_mentioned": 7 | ||||
| 60 | + }, | ||||
| 61 | + "ledger": { | ||||
| 62 | + "facts_total": 65, | ||||
| 63 | + "facts_retained": 36, | ||||
| 64 | + "retention_rate": 0.5538461538461539, | ||||
| 65 | + "retention_by_kind": { | ||||
| 66 | + "person": 0.6666666666666666, | ||||
| 67 | + "date": 0.6, | ||||
| 68 | + "amount": 0.38461538461538464, | ||||
| 69 | + "status": 1.0, | ||||
| 70 | + "place": 0.0, | ||||
| 71 | + "identifier": 0.5, | ||||
| 72 | + "quantity": 0.5 | ||||
| 73 | + }, | ||||
| 74 | + "unsupported_numbers": 0, | ||||
| 75 | + "unsupported_identifiers": 0, | ||||
| 76 | + "distorted_sentences": 0, | ||||
| 77 | + "message_bytes": 1152 | ||||
| 78 | + } | ||||
| 79 | + }, | ||||
| 80 | + "3": { | ||||
| 81 | + "hop_ms": 6284.723916091025, | ||||
| 82 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 83 | + "usage": { | ||||
| 84 | + "sender_input_tokens": 943, | ||||
| 85 | + "sender_output_tokens": 497, | ||||
| 86 | + "sender_prefill_ms": 338.811791036278, | ||||
| 87 | + "sender_ttft_ms": 12.375749996863306, | ||||
| 88 | + "sender_decode_ms": 5932.504500029609 | ||||
| 89 | + }, | ||||
| 90 | + "repair": { | ||||
| 91 | + "lookups": 4, | ||||
| 92 | + "fetched_bytes": 746, | ||||
| 93 | + "codes_mentioned": 7 | ||||
| 94 | + }, | ||||
| 95 | + "ledger": { | ||||
| 96 | + "facts_total": 65, | ||||
| 97 | + "facts_retained": 36, | ||||
| 98 | + "retention_rate": 0.5538461538461539, | ||||
| 99 | + "retention_by_kind": { | ||||
| 100 | + "person": 0.6666666666666666, | ||||
| 101 | + "date": 0.6, | ||||
| 102 | + "amount": 0.38461538461538464, | ||||
| 103 | + "status": 1.0, | ||||
| 104 | + "place": 0.0, | ||||
| 105 | + "identifier": 0.5, | ||||
| 106 | + "quantity": 0.5 | ||||
| 107 | + }, | ||||
| 108 | + "unsupported_numbers": 0, | ||||
| 109 | + "unsupported_identifiers": 0, | ||||
| 110 | + "distorted_sentences": 0, | ||||
| 111 | + "message_bytes": 1152 | ||||
| 112 | + } | ||||
| 113 | + }, | ||||
| 114 | + "4": { | ||||
| 115 | + "hop_ms": 6287.547459010966, | ||||
| 116 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 117 | + "usage": { | ||||
| 118 | + "sender_input_tokens": 943, | ||||
| 119 | + "sender_output_tokens": 497, | ||||
| 120 | + "sender_prefill_ms": 339.0550420153886, | ||||
| 121 | + "sender_ttft_ms": 12.159667094238102, | ||||
| 122 | + "sender_decode_ms": 5935.155290993862 | ||||
| 123 | + }, | ||||
| 124 | + "repair": { | ||||
| 125 | + "lookups": 4, | ||||
| 126 | + "fetched_bytes": 746, | ||||
| 127 | + "codes_mentioned": 7 | ||||
| 128 | + }, | ||||
| 129 | + "ledger": { | ||||
| 130 | + "facts_total": 65, | ||||
| 131 | + "facts_retained": 36, | ||||
| 132 | + "retention_rate": 0.5538461538461539, | ||||
| 133 | + "retention_by_kind": { | ||||
| 134 | + "person": 0.6666666666666666, | ||||
| 135 | + "date": 0.6, | ||||
| 136 | + "amount": 0.38461538461538464, | ||||
| 137 | + "status": 1.0, | ||||
| 138 | + "place": 0.0, | ||||
| 139 | + "identifier": 0.5, | ||||
| 140 | + "quantity": 0.5 | ||||
| 141 | + }, | ||||
| 142 | + "unsupported_numbers": 0, | ||||
| 143 | + "unsupported_identifiers": 0, | ||||
| 144 | + "distorted_sentences": 0, | ||||
| 145 | + "message_bytes": 1152 | ||||
| 146 | + } | ||||
| 147 | + }, | ||||
| 148 | + "5": { | ||||
| 149 | + "hop_ms": 6284.2733329162, | ||||
| 150 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 151 | + "usage": { | ||||
| 152 | + "sender_input_tokens": 943, | ||||
| 153 | + "sender_output_tokens": 497, | ||||
| 154 | + "sender_prefill_ms": 339.422499993816, | ||||
| 155 | + "sender_ttft_ms": 12.437916011549532, | ||||
| 156 | + "sender_decode_ms": 5931.404458009638 | ||||
| 157 | + }, | ||||
| 158 | + "repair": { | ||||
| 159 | + "lookups": 4, | ||||
| 160 | + "fetched_bytes": 746, | ||||
| 161 | + "codes_mentioned": 7 | ||||
| 162 | + }, | ||||
| 163 | + "ledger": { | ||||
| 164 | + "facts_total": 65, | ||||
| 165 | + "facts_retained": 36, | ||||
| 166 | + "retention_rate": 0.5538461538461539, | ||||
| 167 | + "retention_by_kind": { | ||||
| 168 | + "person": 0.6666666666666666, | ||||
| 169 | + "date": 0.6, | ||||
| 170 | + "amount": 0.38461538461538464, | ||||
| 171 | + "status": 1.0, | ||||
| 172 | + "place": 0.0, | ||||
| 173 | + "identifier": 0.5, | ||||
| 174 | + "quantity": 0.5 | ||||
| 175 | + }, | ||||
| 176 | + "unsupported_numbers": 0, | ||||
| 177 | + "unsupported_identifiers": 0, | ||||
| 178 | + "distorted_sentences": 0, | ||||
| 179 | + "message_bytes": 1152 | ||||
| 180 | + } | ||||
| 181 | + }, | ||||
| 182 | + "6": { | ||||
| 183 | + "hop_ms": 6280.639917007647, | ||||
| 184 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 185 | + "usage": { | ||||
| 186 | + "sender_input_tokens": 943, | ||||
| 187 | + "sender_output_tokens": 497, | ||||
| 188 | + "sender_prefill_ms": 338.99291697889566, | ||||
| 189 | + "sender_ttft_ms": 12.106208014301956, | ||||
| 190 | + "sender_decode_ms": 5928.382292040624 | ||||
| 191 | + }, | ||||
| 192 | + "repair": { | ||||
| 193 | + "lookups": 4, | ||||
| 194 | + "fetched_bytes": 746, | ||||
| 195 | + "codes_mentioned": 7 | ||||
| 196 | + }, | ||||
| 197 | + "ledger": { | ||||
| 198 | + "facts_total": 65, | ||||
| 199 | + "facts_retained": 36, | ||||
| 200 | + "retention_rate": 0.5538461538461539, | ||||
| 201 | + "retention_by_kind": { | ||||
| 202 | + "person": 0.6666666666666666, | ||||
| 203 | + "date": 0.6, | ||||
| 204 | + "amount": 0.38461538461538464, | ||||
| 205 | + "status": 1.0, | ||||
| 206 | + "place": 0.0, | ||||
| 207 | + "identifier": 0.5, | ||||
| 208 | + "quantity": 0.5 | ||||
| 209 | + }, | ||||
| 210 | + "unsupported_numbers": 0, | ||||
| 211 | + "unsupported_identifiers": 0, | ||||
| 212 | + "distorted_sentences": 0, | ||||
| 213 | + "message_bytes": 1152 | ||||
| 214 | + } | ||||
| 215 | + }, | ||||
| 216 | + "7": { | ||||
| 217 | + "hop_ms": 6281.036333995871, | ||||
| 218 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 219 | + "usage": { | ||||
| 220 | + "sender_input_tokens": 943, | ||||
| 221 | + "sender_output_tokens": 497, | ||||
| 222 | + "sender_prefill_ms": 338.1226659985259, | ||||
| 223 | + "sender_ttft_ms": 12.170666945166886, | ||||
| 224 | + "sender_decode_ms": 5929.618041962385 | ||||
| 225 | + }, | ||||
| 226 | + "repair": { | ||||
| 227 | + "lookups": 4, | ||||
| 228 | + "fetched_bytes": 746, | ||||
| 229 | + "codes_mentioned": 7 | ||||
| 230 | + }, | ||||
| 231 | + "ledger": { | ||||
| 232 | + "facts_total": 65, | ||||
| 233 | + "facts_retained": 36, | ||||
| 234 | + "retention_rate": 0.5538461538461539, | ||||
| 235 | + "retention_by_kind": { | ||||
| 236 | + "person": 0.6666666666666666, | ||||
| 237 | + "date": 0.6, | ||||
| 238 | + "amount": 0.38461538461538464, | ||||
| 239 | + "status": 1.0, | ||||
| 240 | + "place": 0.0, | ||||
| 241 | + "identifier": 0.5, | ||||
| 242 | + "quantity": 0.5 | ||||
| 243 | + }, | ||||
| 244 | + "unsupported_numbers": 0, | ||||
| 245 | + "unsupported_identifiers": 0, | ||||
| 246 | + "distorted_sentences": 0, | ||||
| 247 | + "message_bytes": 1152 | ||||
| 248 | + } | ||||
| 249 | + }, | ||||
| 250 | + "8": { | ||||
| 251 | + "hop_ms": 6280.703124939464, | ||||
| 252 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 253 | + "usage": { | ||||
| 254 | + "sender_input_tokens": 943, | ||||
| 255 | + "sender_output_tokens": 497, | ||||
| 256 | + "sender_prefill_ms": 338.47095898818225, | ||||
| 257 | + "sender_ttft_ms": 12.123833992518485, | ||||
| 258 | + "sender_decode_ms": 5929.015790927224 | ||||
| 259 | + }, | ||||
| 260 | + "repair": { | ||||
| 261 | + "lookups": 4, | ||||
| 262 | + "fetched_bytes": 746, | ||||
| 263 | + "codes_mentioned": 7 | ||||
| 264 | + }, | ||||
| 265 | + "ledger": { | ||||
| 266 | + "facts_total": 65, | ||||
| 267 | + "facts_retained": 36, | ||||
| 268 | + "retention_rate": 0.5538461538461539, | ||||
| 269 | + "retention_by_kind": { | ||||
| 270 | + "person": 0.6666666666666666, | ||||
| 271 | + "date": 0.6, | ||||
| 272 | + "amount": 0.38461538461538464, | ||||
| 273 | + "status": 1.0, | ||||
| 274 | + "place": 0.0, | ||||
| 275 | + "identifier": 0.5, | ||||
| 276 | + "quantity": 0.5 | ||||
| 277 | + }, | ||||
| 278 | + "unsupported_numbers": 0, | ||||
| 279 | + "unsupported_identifiers": 0, | ||||
| 280 | + "distorted_sentences": 0, | ||||
| 281 | + "message_bytes": 1152 | ||||
| 282 | + } | ||||
| 283 | + } | ||||
| 284 | + } | ||||
| 285 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03021_2000_A5_closed_qwen3b.json
+278 −0
@@ -0,0 +1,278 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}]}", | ||||
| 4 | + "2": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}]}", | ||||
| 5 | + "3": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}]}", | ||||
| 6 | + "4": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}]}", | ||||
| 7 | + "5": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}]}", | ||||
| 8 | + "6": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}]}", | ||||
| 9 | + "7": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}]}", | ||||
| 10 | + "8": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}]}" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6925.180334015749, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2058, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 768.982750014402, | ||||
| 20 | + "sender_ttft_ms": 12.10437505505979, | ||||
| 21 | + "sender_decode_ms": 6141.9624160043895 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 65, | ||||
| 29 | + "facts_retained": 19, | ||||
| 30 | + "retention_rate": 0.2923076923076923, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.16666666666666666, | ||||
| 33 | + "date": 0.1, | ||||
| 34 | + "amount": 0.15384615384615385, | ||||
| 35 | + "status": 1.0, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.16666666666666666, | ||||
| 38 | + "quantity": 0.16666666666666666 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 836 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 4936.230916995555, | ||||
| 48 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 564, | ||||
| 51 | + "sender_output_tokens": 393, | ||||
| 52 | + "sender_prefill_ms": 210.77954198699445, | ||||
| 53 | + "sender_ttft_ms": 11.961582931689918, | ||||
| 54 | + "sender_decode_ms": 4712.778292014264 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 0, | ||||
| 58 | + "fetched_bytes": 0 | ||||
| 59 | + }, | ||||
| 60 | + "ledger": { | ||||
| 61 | + "facts_total": 65, | ||||
| 62 | + "facts_retained": 19, | ||||
| 63 | + "retention_rate": 0.2923076923076923, | ||||
| 64 | + "retention_by_kind": { | ||||
| 65 | + "person": 0.16666666666666666, | ||||
| 66 | + "date": 0.1, | ||||
| 67 | + "amount": 0.15384615384615385, | ||||
| 68 | + "status": 1.0, | ||||
| 69 | + "place": 0.0, | ||||
| 70 | + "identifier": 0.16666666666666666, | ||||
| 71 | + "quantity": 0.16666666666666666 | ||||
| 72 | + }, | ||||
| 73 | + "unsupported_numbers": 0, | ||||
| 74 | + "unsupported_identifiers": 0, | ||||
| 75 | + "distorted_sentences": 0, | ||||
| 76 | + "message_bytes": 836 | ||||
| 77 | + } | ||||
| 78 | + }, | ||||
| 79 | + "3": { | ||||
| 80 | + "hop_ms": 4929.1688749799505, | ||||
| 81 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 82 | + "usage": { | ||||
| 83 | + "sender_input_tokens": 564, | ||||
| 84 | + "sender_output_tokens": 393, | ||||
| 85 | + "sender_prefill_ms": 210.72562492918223, | ||||
| 86 | + "sender_ttft_ms": 11.972750071436167, | ||||
| 87 | + "sender_decode_ms": 4705.818874994293 | ||||
| 88 | + }, | ||||
| 89 | + "repair": { | ||||
| 90 | + "lookups": 0, | ||||
| 91 | + "fetched_bytes": 0 | ||||
| 92 | + }, | ||||
| 93 | + "ledger": { | ||||
| 94 | + "facts_total": 65, | ||||
| 95 | + "facts_retained": 19, | ||||
| 96 | + "retention_rate": 0.2923076923076923, | ||||
| 97 | + "retention_by_kind": { | ||||
| 98 | + "person": 0.16666666666666666, | ||||
| 99 | + "date": 0.1, | ||||
| 100 | + "amount": 0.15384615384615385, | ||||
| 101 | + "status": 1.0, | ||||
| 102 | + "place": 0.0, | ||||
| 103 | + "identifier": 0.16666666666666666, | ||||
| 104 | + "quantity": 0.16666666666666666 | ||||
| 105 | + }, | ||||
| 106 | + "unsupported_numbers": 0, | ||||
| 107 | + "unsupported_identifiers": 0, | ||||
| 108 | + "distorted_sentences": 0, | ||||
| 109 | + "message_bytes": 836 | ||||
| 110 | + } | ||||
| 111 | + }, | ||||
| 112 | + "4": { | ||||
| 113 | + "hop_ms": 4928.251084056683, | ||||
| 114 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 115 | + "usage": { | ||||
| 116 | + "sender_input_tokens": 564, | ||||
| 117 | + "sender_output_tokens": 393, | ||||
| 118 | + "sender_prefill_ms": 210.36466700024903, | ||||
| 119 | + "sender_ttft_ms": 11.931541957892478, | ||||
| 120 | + "sender_decode_ms": 4705.262999981642 | ||||
| 121 | + }, | ||||
| 122 | + "repair": { | ||||
| 123 | + "lookups": 0, | ||||
| 124 | + "fetched_bytes": 0 | ||||
| 125 | + }, | ||||
| 126 | + "ledger": { | ||||
| 127 | + "facts_total": 65, | ||||
| 128 | + "facts_retained": 19, | ||||
| 129 | + "retention_rate": 0.2923076923076923, | ||||
| 130 | + "retention_by_kind": { | ||||
| 131 | + "person": 0.16666666666666666, | ||||
| 132 | + "date": 0.1, | ||||
| 133 | + "amount": 0.15384615384615385, | ||||
| 134 | + "status": 1.0, | ||||
| 135 | + "place": 0.0, | ||||
| 136 | + "identifier": 0.16666666666666666, | ||||
| 137 | + "quantity": 0.16666666666666666 | ||||
| 138 | + }, | ||||
| 139 | + "unsupported_numbers": 0, | ||||
| 140 | + "unsupported_identifiers": 0, | ||||
| 141 | + "distorted_sentences": 0, | ||||
| 142 | + "message_bytes": 836 | ||||
| 143 | + } | ||||
| 144 | + }, | ||||
| 145 | + "5": { | ||||
| 146 | + "hop_ms": 4930.099040968344, | ||||
| 147 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 148 | + "usage": { | ||||
| 149 | + "sender_input_tokens": 564, | ||||
| 150 | + "sender_output_tokens": 393, | ||||
| 151 | + "sender_prefill_ms": 210.20329208113253, | ||||
| 152 | + "sender_ttft_ms": 12.095042038708925, | ||||
| 153 | + "sender_decode_ms": 4707.057165913284 | ||||
| 154 | + }, | ||||
| 155 | + "repair": { | ||||
| 156 | + "lookups": 0, | ||||
| 157 | + "fetched_bytes": 0 | ||||
| 158 | + }, | ||||
| 159 | + "ledger": { | ||||
| 160 | + "facts_total": 65, | ||||
| 161 | + "facts_retained": 19, | ||||
| 162 | + "retention_rate": 0.2923076923076923, | ||||
| 163 | + "retention_by_kind": { | ||||
| 164 | + "person": 0.16666666666666666, | ||||
| 165 | + "date": 0.1, | ||||
| 166 | + "amount": 0.15384615384615385, | ||||
| 167 | + "status": 1.0, | ||||
| 168 | + "place": 0.0, | ||||
| 169 | + "identifier": 0.16666666666666666, | ||||
| 170 | + "quantity": 0.16666666666666666 | ||||
| 171 | + }, | ||||
| 172 | + "unsupported_numbers": 0, | ||||
| 173 | + "unsupported_identifiers": 0, | ||||
| 174 | + "distorted_sentences": 0, | ||||
| 175 | + "message_bytes": 836 | ||||
| 176 | + } | ||||
| 177 | + }, | ||||
| 178 | + "6": { | ||||
| 179 | + "hop_ms": 4925.894750049338, | ||||
| 180 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 181 | + "usage": { | ||||
| 182 | + "sender_input_tokens": 564, | ||||
| 183 | + "sender_output_tokens": 393, | ||||
| 184 | + "sender_prefill_ms": 210.17787500750273, | ||||
| 185 | + "sender_ttft_ms": 12.07441696897149, | ||||
| 186 | + "sender_decode_ms": 4702.866000006907 | ||||
| 187 | + }, | ||||
| 188 | + "repair": { | ||||
| 189 | + "lookups": 0, | ||||
| 190 | + "fetched_bytes": 0 | ||||
| 191 | + }, | ||||
| 192 | + "ledger": { | ||||
| 193 | + "facts_total": 65, | ||||
| 194 | + "facts_retained": 19, | ||||
| 195 | + "retention_rate": 0.2923076923076923, | ||||
| 196 | + "retention_by_kind": { | ||||
| 197 | + "person": 0.16666666666666666, | ||||
| 198 | + "date": 0.1, | ||||
| 199 | + "amount": 0.15384615384615385, | ||||
| 200 | + "status": 1.0, | ||||
| 201 | + "place": 0.0, | ||||
| 202 | + "identifier": 0.16666666666666666, | ||||
| 203 | + "quantity": 0.16666666666666666 | ||||
| 204 | + }, | ||||
| 205 | + "unsupported_numbers": 0, | ||||
| 206 | + "unsupported_identifiers": 0, | ||||
| 207 | + "distorted_sentences": 0, | ||||
| 208 | + "message_bytes": 836 | ||||
| 209 | + } | ||||
| 210 | + }, | ||||
| 211 | + "7": { | ||||
| 212 | + "hop_ms": 4927.353916922584, | ||||
| 213 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 214 | + "usage": { | ||||
| 215 | + "sender_input_tokens": 564, | ||||
| 216 | + "sender_output_tokens": 393, | ||||
| 217 | + "sender_prefill_ms": 210.33799997530878, | ||||
| 218 | + "sender_ttft_ms": 11.99854095466435, | ||||
| 219 | + "sender_decode_ms": 4704.242457984947 | ||||
| 220 | + }, | ||||
| 221 | + "repair": { | ||||
| 222 | + "lookups": 0, | ||||
| 223 | + "fetched_bytes": 0 | ||||
| 224 | + }, | ||||
| 225 | + "ledger": { | ||||
| 226 | + "facts_total": 65, | ||||
| 227 | + "facts_retained": 19, | ||||
| 228 | + "retention_rate": 0.2923076923076923, | ||||
| 229 | + "retention_by_kind": { | ||||
| 230 | + "person": 0.16666666666666666, | ||||
| 231 | + "date": 0.1, | ||||
| 232 | + "amount": 0.15384615384615385, | ||||
| 233 | + "status": 1.0, | ||||
| 234 | + "place": 0.0, | ||||
| 235 | + "identifier": 0.16666666666666666, | ||||
| 236 | + "quantity": 0.16666666666666666 | ||||
| 237 | + }, | ||||
| 238 | + "unsupported_numbers": 0, | ||||
| 239 | + "unsupported_identifiers": 0, | ||||
| 240 | + "distorted_sentences": 0, | ||||
| 241 | + "message_bytes": 836 | ||||
| 242 | + } | ||||
| 243 | + }, | ||||
| 244 | + "8": { | ||||
| 245 | + "hop_ms": 4925.06520904135, | ||||
| 246 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 247 | + "usage": { | ||||
| 248 | + "sender_input_tokens": 564, | ||||
| 249 | + "sender_output_tokens": 393, | ||||
| 250 | + "sender_prefill_ms": 210.15220799017698, | ||||
| 251 | + "sender_ttft_ms": 11.89854193944484, | ||||
| 252 | + "sender_decode_ms": 4702.267332933843 | ||||
| 253 | + }, | ||||
| 254 | + "repair": { | ||||
| 255 | + "lookups": 0, | ||||
| 256 | + "fetched_bytes": 0 | ||||
| 257 | + }, | ||||
| 258 | + "ledger": { | ||||
| 259 | + "facts_total": 65, | ||||
| 260 | + "facts_retained": 19, | ||||
| 261 | + "retention_rate": 0.2923076923076923, | ||||
| 262 | + "retention_by_kind": { | ||||
| 263 | + "person": 0.16666666666666666, | ||||
| 264 | + "date": 0.1, | ||||
| 265 | + "amount": 0.15384615384615385, | ||||
| 266 | + "status": 1.0, | ||||
| 267 | + "place": 0.0, | ||||
| 268 | + "identifier": 0.16666666666666666, | ||||
| 269 | + "quantity": 0.16666666666666666 | ||||
| 270 | + }, | ||||
| 271 | + "unsupported_numbers": 0, | ||||
| 272 | + "unsupported_identifiers": 0, | ||||
| 273 | + "distorted_sentences": 0, | ||||
| 274 | + "message_bytes": 836 | ||||
| 275 | + } | ||||
| 276 | + } | ||||
| 277 | + } | ||||
| 278 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03021_2000_A5_closed_qwen3b_llama3b.json
+278 −0
@@ -0,0 +1,278 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}]}", | ||||
| 4 | + "2": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"quote\": \"proposed by Kwame Varga\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"quote\": \"4,862,425 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"quote\": \"5,646,720 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"quote\": \"27 May 2034\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"quote\": \"14 January 2035\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"quote\": \"22.3 MW\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"quote\": \"MH-96F-2099\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"quote\": \"NOT cancelled\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"quote\": \"21.4976\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 5 | + "3": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"quote\": \"proposed by Kwame Varga\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"quote\": \"4,862,425 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"quote\": \"5,646,720 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"quote\": \"27 May 2034\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"quote\": \"14 January 2035\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"quote\": \"22.3 MW\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"quote\": \"MH-96F-2099\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"quote\": \"NOT cancelled\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"quote\": \"21.4976\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 6 | + "4": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"quote\": \"proposed by Kwame Varga\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"quote\": \"4,862,425 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"quote\": \"5,646,720 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"quote\": \"27 May 2034\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"quote\": \"14 January 2035\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"quote\": \"22.3 MW\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"quote\": \"MH-96F-2099\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"quote\": \"NOT cancelled\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"quote\": \"21.4976\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 7 | + "5": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"quote\": \"proposed by Kwame Varga\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"quote\": \"4,862,425 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"quote\": \"5,646,720 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"quote\": \"27 May 2034\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"quote\": \"14 January 2035\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"quote\": \"22.3 MW\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"quote\": \"MH-96F-2099\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"quote\": \"NOT cancelled\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"quote\": \"21.4976\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 8 | + "6": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"quote\": \"proposed by Kwame Varga\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"quote\": \"4,862,425 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"quote\": \"5,646,720 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"quote\": \"27 May 2034\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"quote\": \"14 January 2035\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"quote\": \"22.3 MW\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"quote\": \"MH-96F-2099\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"quote\": \"NOT cancelled\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"quote\": \"21.4976\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 9 | + "7": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"quote\": \"proposed by Kwame Varga\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"quote\": \"4,862,425 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"quote\": \"5,646,720 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"quote\": \"27 May 2034\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"quote\": \"14 January 2035\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"quote\": \"22.3 MW\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"quote\": \"MH-96F-2099\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"quote\": \"NOT cancelled\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"quote\": \"21.4976\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 10 | + "8": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"quote\": \"proposed by Kwame Varga\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"quote\": \"4,862,425 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"quote\": \"5,646,720 CAD\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"quote\": \"27 May 2034\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"quote\": \"14 January 2035\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"quote\": \"22.3 MW\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"quote\": \"MH-96F-2099\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"quote\": \"NOT cancelled\"}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"quote\": \"21.4976\"}], \"notes\": \"\", \"unknowns\": []}" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6896.219208021648, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2058, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 717.895417008549, | ||||
| 20 | + "sender_ttft_ms": 12.135000084526837, | ||||
| 21 | + "sender_decode_ms": 6163.929250091314 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 65, | ||||
| 29 | + "facts_retained": 19, | ||||
| 30 | + "retention_rate": 0.2923076923076923, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.16666666666666666, | ||||
| 33 | + "date": 0.1, | ||||
| 34 | + "amount": 0.15384615384615385, | ||||
| 35 | + "status": 1.0, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.16666666666666666, | ||||
| 38 | + "quantity": 0.16666666666666666 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 836 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 4294.3743750220165, | ||||
| 48 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 531, | ||||
| 51 | + "sender_output_tokens": 350, | ||||
| 52 | + "sender_prefill_ms": 215.72124992962927, | ||||
| 53 | + "sender_ttft_ms": 11.779666994698346, | ||||
| 54 | + "sender_decode_ms": 4066.057833028026 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 0, | ||||
| 58 | + "fetched_bytes": 0 | ||||
| 59 | + }, | ||||
| 60 | + "ledger": { | ||||
| 61 | + "facts_total": 65, | ||||
| 62 | + "facts_retained": 19, | ||||
| 63 | + "retention_rate": 0.2923076923076923, | ||||
| 64 | + "retention_by_kind": { | ||||
| 65 | + "person": 0.16666666666666666, | ||||
| 66 | + "date": 0.1, | ||||
| 67 | + "amount": 0.15384615384615385, | ||||
| 68 | + "status": 1.0, | ||||
| 69 | + "place": 0.0, | ||||
| 70 | + "identifier": 0.16666666666666666, | ||||
| 71 | + "quantity": 0.16666666666666666 | ||||
| 72 | + }, | ||||
| 73 | + "unsupported_numbers": 0, | ||||
| 74 | + "unsupported_identifiers": 0, | ||||
| 75 | + "distorted_sentences": 0, | ||||
| 76 | + "message_bytes": 985 | ||||
| 77 | + } | ||||
| 78 | + }, | ||||
| 79 | + "3": { | ||||
| 80 | + "hop_ms": 4930.94241595827, | ||||
| 81 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 82 | + "usage": { | ||||
| 83 | + "sender_input_tokens": 576, | ||||
| 84 | + "sender_output_tokens": 392, | ||||
| 85 | + "sender_prefill_ms": 215.70654190145433, | ||||
| 86 | + "sender_ttft_ms": 12.118375045247376, | ||||
| 87 | + "sender_decode_ms": 4702.2593329893425 | ||||
| 88 | + }, | ||||
| 89 | + "repair": { | ||||
| 90 | + "lookups": 0, | ||||
| 91 | + "fetched_bytes": 0 | ||||
| 92 | + }, | ||||
| 93 | + "ledger": { | ||||
| 94 | + "facts_total": 65, | ||||
| 95 | + "facts_retained": 19, | ||||
| 96 | + "retention_rate": 0.2923076923076923, | ||||
| 97 | + "retention_by_kind": { | ||||
| 98 | + "person": 0.16666666666666666, | ||||
| 99 | + "date": 0.1, | ||||
| 100 | + "amount": 0.15384615384615385, | ||||
| 101 | + "status": 1.0, | ||||
| 102 | + "place": 0.0, | ||||
| 103 | + "identifier": 0.16666666666666666, | ||||
| 104 | + "quantity": 0.16666666666666666 | ||||
| 105 | + }, | ||||
| 106 | + "unsupported_numbers": 0, | ||||
| 107 | + "unsupported_identifiers": 0, | ||||
| 108 | + "distorted_sentences": 0, | ||||
| 109 | + "message_bytes": 985 | ||||
| 110 | + } | ||||
| 111 | + }, | ||||
| 112 | + "4": { | ||||
| 113 | + "hop_ms": 4305.2063341019675, | ||||
| 114 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 115 | + "usage": { | ||||
| 116 | + "sender_input_tokens": 554, | ||||
| 117 | + "sender_output_tokens": 350, | ||||
| 118 | + "sender_prefill_ms": 220.93599999789149, | ||||
| 119 | + "sender_ttft_ms": 11.642999947071075, | ||||
| 120 | + "sender_decode_ms": 4071.795874973759 | ||||
| 121 | + }, | ||||
| 122 | + "repair": { | ||||
| 123 | + "lookups": 0, | ||||
| 124 | + "fetched_bytes": 0 | ||||
| 125 | + }, | ||||
| 126 | + "ledger": { | ||||
| 127 | + "facts_total": 65, | ||||
| 128 | + "facts_retained": 19, | ||||
| 129 | + "retention_rate": 0.2923076923076923, | ||||
| 130 | + "retention_by_kind": { | ||||
| 131 | + "person": 0.16666666666666666, | ||||
| 132 | + "date": 0.1, | ||||
| 133 | + "amount": 0.15384615384615385, | ||||
| 134 | + "status": 1.0, | ||||
| 135 | + "place": 0.0, | ||||
| 136 | + "identifier": 0.16666666666666666, | ||||
| 137 | + "quantity": 0.16666666666666666 | ||||
| 138 | + }, | ||||
| 139 | + "unsupported_numbers": 0, | ||||
| 140 | + "unsupported_identifiers": 0, | ||||
| 141 | + "distorted_sentences": 0, | ||||
| 142 | + "message_bytes": 985 | ||||
| 143 | + } | ||||
| 144 | + }, | ||||
| 145 | + "5": { | ||||
| 146 | + "hop_ms": 4931.834749993868, | ||||
| 147 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 148 | + "usage": { | ||||
| 149 | + "sender_input_tokens": 576, | ||||
| 150 | + "sender_output_tokens": 392, | ||||
| 151 | + "sender_prefill_ms": 215.5662920558825, | ||||
| 152 | + "sender_ttft_ms": 12.074165977537632, | ||||
| 153 | + "sender_decode_ms": 4703.380250022747 | ||||
| 154 | + }, | ||||
| 155 | + "repair": { | ||||
| 156 | + "lookups": 0, | ||||
| 157 | + "fetched_bytes": 0 | ||||
| 158 | + }, | ||||
| 159 | + "ledger": { | ||||
| 160 | + "facts_total": 65, | ||||
| 161 | + "facts_retained": 19, | ||||
| 162 | + "retention_rate": 0.2923076923076923, | ||||
| 163 | + "retention_by_kind": { | ||||
| 164 | + "person": 0.16666666666666666, | ||||
| 165 | + "date": 0.1, | ||||
| 166 | + "amount": 0.15384615384615385, | ||||
| 167 | + "status": 1.0, | ||||
| 168 | + "place": 0.0, | ||||
| 169 | + "identifier": 0.16666666666666666, | ||||
| 170 | + "quantity": 0.16666666666666666 | ||||
| 171 | + }, | ||||
| 172 | + "unsupported_numbers": 0, | ||||
| 173 | + "unsupported_identifiers": 0, | ||||
| 174 | + "distorted_sentences": 0, | ||||
| 175 | + "message_bytes": 985 | ||||
| 176 | + } | ||||
| 177 | + }, | ||||
| 178 | + "6": { | ||||
| 179 | + "hop_ms": 4301.946583087556, | ||||
| 180 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 181 | + "usage": { | ||||
| 182 | + "sender_input_tokens": 554, | ||||
| 183 | + "sender_output_tokens": 350, | ||||
| 184 | + "sender_prefill_ms": 217.02941600233316, | ||||
| 185 | + "sender_ttft_ms": 11.652959045022726, | ||||
| 186 | + "sender_decode_ms": 4072.438874980435 | ||||
| 187 | + }, | ||||
| 188 | + "repair": { | ||||
| 189 | + "lookups": 0, | ||||
| 190 | + "fetched_bytes": 0 | ||||
| 191 | + }, | ||||
| 192 | + "ledger": { | ||||
| 193 | + "facts_total": 65, | ||||
| 194 | + "facts_retained": 19, | ||||
| 195 | + "retention_rate": 0.2923076923076923, | ||||
| 196 | + "retention_by_kind": { | ||||
| 197 | + "person": 0.16666666666666666, | ||||
| 198 | + "date": 0.1, | ||||
| 199 | + "amount": 0.15384615384615385, | ||||
| 200 | + "status": 1.0, | ||||
| 201 | + "place": 0.0, | ||||
| 202 | + "identifier": 0.16666666666666666, | ||||
| 203 | + "quantity": 0.16666666666666666 | ||||
| 204 | + }, | ||||
| 205 | + "unsupported_numbers": 0, | ||||
| 206 | + "unsupported_identifiers": 0, | ||||
| 207 | + "distorted_sentences": 0, | ||||
| 208 | + "message_bytes": 985 | ||||
| 209 | + } | ||||
| 210 | + }, | ||||
| 211 | + "7": { | ||||
| 212 | + "hop_ms": 4939.746499992907, | ||||
| 213 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 214 | + "usage": { | ||||
| 215 | + "sender_input_tokens": 576, | ||||
| 216 | + "sender_output_tokens": 392, | ||||
| 217 | + "sender_prefill_ms": 217.03141706530005, | ||||
| 218 | + "sender_ttft_ms": 12.172833899967372, | ||||
| 219 | + "sender_decode_ms": 4709.68566602096 | ||||
| 220 | + }, | ||||
| 221 | + "repair": { | ||||
| 222 | + "lookups": 0, | ||||
| 223 | + "fetched_bytes": 0 | ||||
| 224 | + }, | ||||
| 225 | + "ledger": { | ||||
| 226 | + "facts_total": 65, | ||||
| 227 | + "facts_retained": 19, | ||||
| 228 | + "retention_rate": 0.2923076923076923, | ||||
| 229 | + "retention_by_kind": { | ||||
| 230 | + "person": 0.16666666666666666, | ||||
| 231 | + "date": 0.1, | ||||
| 232 | + "amount": 0.15384615384615385, | ||||
| 233 | + "status": 1.0, | ||||
| 234 | + "place": 0.0, | ||||
| 235 | + "identifier": 0.16666666666666666, | ||||
| 236 | + "quantity": 0.16666666666666666 | ||||
| 237 | + }, | ||||
| 238 | + "unsupported_numbers": 0, | ||||
| 239 | + "unsupported_identifiers": 0, | ||||
| 240 | + "distorted_sentences": 0, | ||||
| 241 | + "message_bytes": 985 | ||||
| 242 | + } | ||||
| 243 | + }, | ||||
| 244 | + "8": { | ||||
| 245 | + "hop_ms": 4308.1359170610085, | ||||
| 246 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 247 | + "usage": { | ||||
| 248 | + "sender_input_tokens": 554, | ||||
| 249 | + "sender_output_tokens": 350, | ||||
| 250 | + "sender_prefill_ms": 227.350625093095, | ||||
| 251 | + "sender_ttft_ms": 11.814708937890828, | ||||
| 252 | + "sender_decode_ms": 4068.155749933794 | ||||
| 253 | + }, | ||||
| 254 | + "repair": { | ||||
| 255 | + "lookups": 0, | ||||
| 256 | + "fetched_bytes": 0 | ||||
| 257 | + }, | ||||
| 258 | + "ledger": { | ||||
| 259 | + "facts_total": 65, | ||||
| 260 | + "facts_retained": 19, | ||||
| 261 | + "retention_rate": 0.2923076923076923, | ||||
| 262 | + "retention_by_kind": { | ||||
| 263 | + "person": 0.16666666666666666, | ||||
| 264 | + "date": 0.1, | ||||
| 265 | + "amount": 0.15384615384615385, | ||||
| 266 | + "status": 1.0, | ||||
| 267 | + "place": 0.0, | ||||
| 268 | + "identifier": 0.16666666666666666, | ||||
| 269 | + "quantity": 0.16666666666666666 | ||||
| 270 | + }, | ||||
| 271 | + "unsupported_numbers": 0, | ||||
| 272 | + "unsupported_identifiers": 0, | ||||
| 273 | + "distorted_sentences": 0, | ||||
| 274 | + "message_bytes": 985 | ||||
| 275 | + } | ||||
| 276 | + } | ||||
| 277 | + } | ||||
| 278 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03021_2000_A5_repairable_qwen3b.json
+285 −0
@@ -0,0 +1,285 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}]}", | ||||
| 4 | + "2": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}], \"unknowns\": [], \"notes\": null}", | ||||
| 5 | + "3": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}], \"unknowns\": [], \"notes\": null}", | ||||
| 6 | + "4": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}], \"unknowns\": [], \"notes\": null}", | ||||
| 7 | + "5": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}], \"unknowns\": [], \"notes\": null}", | ||||
| 8 | + "6": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}], \"unknowns\": [], \"notes\": null}", | ||||
| 9 | + "7": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}], \"unknowns\": [], \"notes\": null}", | ||||
| 10 | + "8": "{\"facts\": [{\"entity\": \"Kovar-9\", \"attribute\": \"proposed by\", \"value\": \"Kwame Varga\", \"span\": null}, {\"entity\": \"Kovar-9\", \"attribute\": \"initial budget\", \"value\": \"4,862,425 CAD\", \"span\": [381, 420]}, {\"entity\": \"Kovar-9\", \"attribute\": \"budget revised to\", \"value\": \"5,646,720 CAD\", \"span\": [422, 487]}, {\"entity\": \"Kovar-9\", \"attribute\": \"approved decision\", \"value\": \"27 May 2034\", \"span\": [489, 550]}, {\"entity\": \"Kovar-9\", \"attribute\": \"launch postponed to\", \"value\": \"14 January 2035\", \"span\": [679, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"rated capacity\", \"value\": \"22.3 MW\", \"span\": [724, 764]}, {\"entity\": \"Kovar-9\", \"attribute\": \"supplier identifier\", \"value\": \"MH-96F-2099\", \"span\": [600, 650]}, {\"entity\": \"Kovar-9\", \"attribute\": \"status\", \"value\": \"NOT cancelled\", \"span\": [652, 722]}, {\"entity\": \"Kovar-9\", \"attribute\": \"calibration constant\", \"value\": \"21.4976\", \"span\": [766, 819]}], \"unknowns\": [], \"notes\": null}" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6858.334750053473, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2058, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 712.6237920019776, | ||||
| 20 | + "sender_ttft_ms": 12.069083983078599, | ||||
| 21 | + "sender_decode_ms": 6131.409666966647 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 65, | ||||
| 29 | + "facts_retained": 19, | ||||
| 30 | + "retention_rate": 0.2923076923076923, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.16666666666666666, | ||||
| 33 | + "date": 0.1, | ||||
| 34 | + "amount": 0.15384615384615385, | ||||
| 35 | + "status": 1.0, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.16666666666666666, | ||||
| 38 | + "quantity": 0.16666666666666666 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 836 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 4976.647916948423, | ||||
| 48 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 774, | ||||
| 51 | + "sender_output_tokens": 389, | ||||
| 52 | + "sender_prefill_ms": 290.5328751076013, | ||||
| 53 | + "sender_ttft_ms": 12.236707960255444, | ||||
| 54 | + "sender_decode_ms": 4672.9058750206605 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 1, | ||||
| 58 | + "fetched_bytes": 497, | ||||
| 59 | + "codes_mentioned": 1 | ||||
| 60 | + }, | ||||
| 61 | + "ledger": { | ||||
| 62 | + "facts_total": 65, | ||||
| 63 | + "facts_retained": 19, | ||||
| 64 | + "retention_rate": 0.2923076923076923, | ||||
| 65 | + "retention_by_kind": { | ||||
| 66 | + "person": 0.16666666666666666, | ||||
| 67 | + "date": 0.1, | ||||
| 68 | + "amount": 0.15384615384615385, | ||||
| 69 | + "status": 1.0, | ||||
| 70 | + "place": 0.0, | ||||
| 71 | + "identifier": 0.16666666666666666, | ||||
| 72 | + "quantity": 0.16666666666666666 | ||||
| 73 | + }, | ||||
| 74 | + "unsupported_numbers": 0, | ||||
| 75 | + "unsupported_identifiers": 0, | ||||
| 76 | + "distorted_sentences": 0, | ||||
| 77 | + "message_bytes": 867 | ||||
| 78 | + } | ||||
| 79 | + }, | ||||
| 80 | + "3": { | ||||
| 81 | + "hop_ms": 4970.926292007789, | ||||
| 82 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 83 | + "usage": { | ||||
| 84 | + "sender_input_tokens": 783, | ||||
| 85 | + "sender_output_tokens": 389, | ||||
| 86 | + "sender_prefill_ms": 291.5153329959139, | ||||
| 87 | + "sender_ttft_ms": 12.148582958616316, | ||||
| 88 | + "sender_decode_ms": 4666.272957925685 | ||||
| 89 | + }, | ||||
| 90 | + "repair": { | ||||
| 91 | + "lookups": 1, | ||||
| 92 | + "fetched_bytes": 497, | ||||
| 93 | + "codes_mentioned": 1 | ||||
| 94 | + }, | ||||
| 95 | + "ledger": { | ||||
| 96 | + "facts_total": 65, | ||||
| 97 | + "facts_retained": 19, | ||||
| 98 | + "retention_rate": 0.2923076923076923, | ||||
| 99 | + "retention_by_kind": { | ||||
| 100 | + "person": 0.16666666666666666, | ||||
| 101 | + "date": 0.1, | ||||
| 102 | + "amount": 0.15384615384615385, | ||||
| 103 | + "status": 1.0, | ||||
| 104 | + "place": 0.0, | ||||
| 105 | + "identifier": 0.16666666666666666, | ||||
| 106 | + "quantity": 0.16666666666666666 | ||||
| 107 | + }, | ||||
| 108 | + "unsupported_numbers": 0, | ||||
| 109 | + "unsupported_identifiers": 0, | ||||
| 110 | + "distorted_sentences": 0, | ||||
| 111 | + "message_bytes": 867 | ||||
| 112 | + } | ||||
| 113 | + }, | ||||
| 114 | + "4": { | ||||
| 115 | + "hop_ms": 4976.015500025824, | ||||
| 116 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 117 | + "usage": { | ||||
| 118 | + "sender_input_tokens": 783, | ||||
| 119 | + "sender_output_tokens": 389, | ||||
| 120 | + "sender_prefill_ms": 290.5076660681516, | ||||
| 121 | + "sender_ttft_ms": 12.1275830315426, | ||||
| 122 | + "sender_decode_ms": 4672.412124928087 | ||||
| 123 | + }, | ||||
| 124 | + "repair": { | ||||
| 125 | + "lookups": 1, | ||||
| 126 | + "fetched_bytes": 497, | ||||
| 127 | + "codes_mentioned": 1 | ||||
| 128 | + }, | ||||
| 129 | + "ledger": { | ||||
| 130 | + "facts_total": 65, | ||||
| 131 | + "facts_retained": 19, | ||||
| 132 | + "retention_rate": 0.2923076923076923, | ||||
| 133 | + "retention_by_kind": { | ||||
| 134 | + "person": 0.16666666666666666, | ||||
| 135 | + "date": 0.1, | ||||
| 136 | + "amount": 0.15384615384615385, | ||||
| 137 | + "status": 1.0, | ||||
| 138 | + "place": 0.0, | ||||
| 139 | + "identifier": 0.16666666666666666, | ||||
| 140 | + "quantity": 0.16666666666666666 | ||||
| 141 | + }, | ||||
| 142 | + "unsupported_numbers": 0, | ||||
| 143 | + "unsupported_identifiers": 0, | ||||
| 144 | + "distorted_sentences": 0, | ||||
| 145 | + "message_bytes": 867 | ||||
| 146 | + } | ||||
| 147 | + }, | ||||
| 148 | + "5": { | ||||
| 149 | + "hop_ms": 4970.625541987829, | ||||
| 150 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 151 | + "usage": { | ||||
| 152 | + "sender_input_tokens": 783, | ||||
| 153 | + "sender_output_tokens": 389, | ||||
| 154 | + "sender_prefill_ms": 291.19820799678564, | ||||
| 155 | + "sender_ttft_ms": 12.023292016237974, | ||||
| 156 | + "sender_decode_ms": 4666.442916030064 | ||||
| 157 | + }, | ||||
| 158 | + "repair": { | ||||
| 159 | + "lookups": 1, | ||||
| 160 | + "fetched_bytes": 497, | ||||
| 161 | + "codes_mentioned": 1 | ||||
| 162 | + }, | ||||
| 163 | + "ledger": { | ||||
| 164 | + "facts_total": 65, | ||||
| 165 | + "facts_retained": 19, | ||||
| 166 | + "retention_rate": 0.2923076923076923, | ||||
| 167 | + "retention_by_kind": { | ||||
| 168 | + "person": 0.16666666666666666, | ||||
| 169 | + "date": 0.1, | ||||
| 170 | + "amount": 0.15384615384615385, | ||||
| 171 | + "status": 1.0, | ||||
| 172 | + "place": 0.0, | ||||
| 173 | + "identifier": 0.16666666666666666, | ||||
| 174 | + "quantity": 0.16666666666666666 | ||||
| 175 | + }, | ||||
| 176 | + "unsupported_numbers": 0, | ||||
| 177 | + "unsupported_identifiers": 0, | ||||
| 178 | + "distorted_sentences": 0, | ||||
| 179 | + "message_bytes": 867 | ||||
| 180 | + } | ||||
| 181 | + }, | ||||
| 182 | + "6": { | ||||
| 183 | + "hop_ms": 7763.661833014339, | ||||
| 184 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 185 | + "usage": { | ||||
| 186 | + "sender_input_tokens": 783, | ||||
| 187 | + "sender_output_tokens": 389, | ||||
| 188 | + "sender_prefill_ms": 290.7006669556722, | ||||
| 189 | + "sender_ttft_ms": 12.178458971902728, | ||||
| 190 | + "sender_decode_ms": 7459.693666081876 | ||||
| 191 | + }, | ||||
| 192 | + "repair": { | ||||
| 193 | + "lookups": 1, | ||||
| 194 | + "fetched_bytes": 497, | ||||
| 195 | + "codes_mentioned": 1 | ||||
| 196 | + }, | ||||
| 197 | + "ledger": { | ||||
| 198 | + "facts_total": 65, | ||||
| 199 | + "facts_retained": 19, | ||||
| 200 | + "retention_rate": 0.2923076923076923, | ||||
| 201 | + "retention_by_kind": { | ||||
| 202 | + "person": 0.16666666666666666, | ||||
| 203 | + "date": 0.1, | ||||
| 204 | + "amount": 0.15384615384615385, | ||||
| 205 | + "status": 1.0, | ||||
| 206 | + "place": 0.0, | ||||
| 207 | + "identifier": 0.16666666666666666, | ||||
| 208 | + "quantity": 0.16666666666666666 | ||||
| 209 | + }, | ||||
| 210 | + "unsupported_numbers": 0, | ||||
| 211 | + "unsupported_identifiers": 0, | ||||
| 212 | + "distorted_sentences": 0, | ||||
| 213 | + "message_bytes": 867 | ||||
| 214 | + } | ||||
| 215 | + }, | ||||
| 216 | + "7": { | ||||
| 217 | + "hop_ms": 19990.075874957256, | ||||
| 218 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 219 | + "usage": { | ||||
| 220 | + "sender_input_tokens": 783, | ||||
| 221 | + "sender_output_tokens": 389, | ||||
| 222 | + "sender_prefill_ms": 513.3305419003591, | ||||
| 223 | + "sender_ttft_ms": 33.72154210228473, | ||||
| 224 | + "sender_decode_ms": 19441.817832994275 | ||||
| 225 | + }, | ||||
| 226 | + "repair": { | ||||
| 227 | + "lookups": 1, | ||||
| 228 | + "fetched_bytes": 497, | ||||
| 229 | + "codes_mentioned": 1 | ||||
| 230 | + }, | ||||
| 231 | + "ledger": { | ||||
| 232 | + "facts_total": 65, | ||||
| 233 | + "facts_retained": 19, | ||||
| 234 | + "retention_rate": 0.2923076923076923, | ||||
| 235 | + "retention_by_kind": { | ||||
| 236 | + "person": 0.16666666666666666, | ||||
| 237 | + "date": 0.1, | ||||
| 238 | + "amount": 0.15384615384615385, | ||||
| 239 | + "status": 1.0, | ||||
| 240 | + "place": 0.0, | ||||
| 241 | + "identifier": 0.16666666666666666, | ||||
| 242 | + "quantity": 0.16666666666666666 | ||||
| 243 | + }, | ||||
| 244 | + "unsupported_numbers": 0, | ||||
| 245 | + "unsupported_identifiers": 0, | ||||
| 246 | + "distorted_sentences": 0, | ||||
| 247 | + "message_bytes": 867 | ||||
| 248 | + } | ||||
| 249 | + }, | ||||
| 250 | + "8": { | ||||
| 251 | + "hop_ms": 19888.057208037935, | ||||
| 252 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 253 | + "usage": { | ||||
| 254 | + "sender_input_tokens": 783, | ||||
| 255 | + "sender_output_tokens": 389, | ||||
| 256 | + "sender_prefill_ms": 504.5799999497831, | ||||
| 257 | + "sender_ttft_ms": 67.3964589368552, | ||||
| 258 | + "sender_decode_ms": 19314.969124970958 | ||||
| 259 | + }, | ||||
| 260 | + "repair": { | ||||
| 261 | + "lookups": 1, | ||||
| 262 | + "fetched_bytes": 497, | ||||
| 263 | + "codes_mentioned": 1 | ||||
| 264 | + }, | ||||
| 265 | + "ledger": { | ||||
| 266 | + "facts_total": 65, | ||||
| 267 | + "facts_retained": 19, | ||||
| 268 | + "retention_rate": 0.2923076923076923, | ||||
| 269 | + "retention_by_kind": { | ||||
| 270 | + "person": 0.16666666666666666, | ||||
| 271 | + "date": 0.1, | ||||
| 272 | + "amount": 0.15384615384615385, | ||||
| 273 | + "status": 1.0, | ||||
| 274 | + "place": 0.0, | ||||
| 275 | + "identifier": 0.16666666666666666, | ||||
| 276 | + "quantity": 0.16666666666666666 | ||||
| 277 | + }, | ||||
| 278 | + "unsupported_numbers": 0, | ||||
| 279 | + "unsupported_identifiers": 0, | ||||
| 280 | + "distorted_sentences": 0, | ||||
| 281 | + "message_bytes": 867 | ||||
| 282 | + } | ||||
| 283 | + } | ||||
| 284 | + } | ||||
| 285 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03024_2000_A4_closed_qwen3b.json
+278 −0
@@ -0,0 +1,278 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "**Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4", | ||||
| 4 | + "2": "**Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4", | ||||
| 5 | + "3": "**Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4", | ||||
| 6 | + "4": "**Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4", | ||||
| 7 | + "5": "**Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4", | ||||
| 8 | + "6": "**Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4", | ||||
| 9 | + "7": "**Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4", | ||||
| 10 | + "8": "**Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6965.8001670613885, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2184, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 783.2872089929879, | ||||
| 20 | + "sender_ttft_ms": 12.196084018796682, | ||||
| 21 | + "sender_decode_ms": 6167.940250015818 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 66, | ||||
| 29 | + "facts_retained": 21, | ||||
| 30 | + "retention_rate": 0.3181818181818182, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.5, | ||||
| 33 | + "date": 0.0, | ||||
| 34 | + "amount": 0.35294117647058826, | ||||
| 35 | + "status": 0.5, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.3333333333333333, | ||||
| 38 | + "quantity": 0.3333333333333333 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 1508 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 6383.797334041446, | ||||
| 48 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 629, | ||||
| 51 | + "sender_output_tokens": 512, | ||||
| 52 | + "sender_prefill_ms": 230.22991605103016, | ||||
| 53 | + "sender_ttft_ms": 12.243499979376793, | ||||
| 54 | + "sender_decode_ms": 6140.55695803836 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 0, | ||||
| 58 | + "fetched_bytes": 0 | ||||
| 59 | + }, | ||||
| 60 | + "ledger": { | ||||
| 61 | + "facts_total": 66, | ||||
| 62 | + "facts_retained": 21, | ||||
| 63 | + "retention_rate": 0.3181818181818182, | ||||
| 64 | + "retention_by_kind": { | ||||
| 65 | + "person": 0.5, | ||||
| 66 | + "date": 0.0, | ||||
| 67 | + "amount": 0.35294117647058826, | ||||
| 68 | + "status": 0.5, | ||||
| 69 | + "place": 0.0, | ||||
| 70 | + "identifier": 0.3333333333333333, | ||||
| 71 | + "quantity": 0.3333333333333333 | ||||
| 72 | + }, | ||||
| 73 | + "unsupported_numbers": 0, | ||||
| 74 | + "unsupported_identifiers": 0, | ||||
| 75 | + "distorted_sentences": 0, | ||||
| 76 | + "message_bytes": 1508 | ||||
| 77 | + } | ||||
| 78 | + }, | ||||
| 79 | + "3": { | ||||
| 80 | + "hop_ms": 6320.953875081614, | ||||
| 81 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 82 | + "usage": { | ||||
| 83 | + "sender_input_tokens": 629, | ||||
| 84 | + "sender_output_tokens": 512, | ||||
| 85 | + "sender_prefill_ms": 229.20179192442447, | ||||
| 86 | + "sender_ttft_ms": 11.847207904793322, | ||||
| 87 | + "sender_decode_ms": 6079.139541019686 | ||||
| 88 | + }, | ||||
| 89 | + "repair": { | ||||
| 90 | + "lookups": 0, | ||||
| 91 | + "fetched_bytes": 0 | ||||
| 92 | + }, | ||||
| 93 | + "ledger": { | ||||
| 94 | + "facts_total": 66, | ||||
| 95 | + "facts_retained": 21, | ||||
| 96 | + "retention_rate": 0.3181818181818182, | ||||
| 97 | + "retention_by_kind": { | ||||
| 98 | + "person": 0.5, | ||||
| 99 | + "date": 0.0, | ||||
| 100 | + "amount": 0.35294117647058826, | ||||
| 101 | + "status": 0.5, | ||||
| 102 | + "place": 0.0, | ||||
| 103 | + "identifier": 0.3333333333333333, | ||||
| 104 | + "quantity": 0.3333333333333333 | ||||
| 105 | + }, | ||||
| 106 | + "unsupported_numbers": 0, | ||||
| 107 | + "unsupported_identifiers": 0, | ||||
| 108 | + "distorted_sentences": 0, | ||||
| 109 | + "message_bytes": 1508 | ||||
| 110 | + } | ||||
| 111 | + }, | ||||
| 112 | + "4": { | ||||
| 113 | + "hop_ms": 6322.3797919927165, | ||||
| 114 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 115 | + "usage": { | ||||
| 116 | + "sender_input_tokens": 629, | ||||
| 117 | + "sender_output_tokens": 512, | ||||
| 118 | + "sender_prefill_ms": 229.06612500082701, | ||||
| 119 | + "sender_ttft_ms": 11.866334010846913, | ||||
| 120 | + "sender_decode_ms": 6080.578541965224 | ||||
| 121 | + }, | ||||
| 122 | + "repair": { | ||||
| 123 | + "lookups": 0, | ||||
| 124 | + "fetched_bytes": 0 | ||||
| 125 | + }, | ||||
| 126 | + "ledger": { | ||||
| 127 | + "facts_total": 66, | ||||
| 128 | + "facts_retained": 21, | ||||
| 129 | + "retention_rate": 0.3181818181818182, | ||||
| 130 | + "retention_by_kind": { | ||||
| 131 | + "person": 0.5, | ||||
| 132 | + "date": 0.0, | ||||
| 133 | + "amount": 0.35294117647058826, | ||||
| 134 | + "status": 0.5, | ||||
| 135 | + "place": 0.0, | ||||
| 136 | + "identifier": 0.3333333333333333, | ||||
| 137 | + "quantity": 0.3333333333333333 | ||||
| 138 | + }, | ||||
| 139 | + "unsupported_numbers": 0, | ||||
| 140 | + "unsupported_identifiers": 0, | ||||
| 141 | + "distorted_sentences": 0, | ||||
| 142 | + "message_bytes": 1508 | ||||
| 143 | + } | ||||
| 144 | + }, | ||||
| 145 | + "5": { | ||||
| 146 | + "hop_ms": 6315.4535830253735, | ||||
| 147 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 148 | + "usage": { | ||||
| 149 | + "sender_input_tokens": 629, | ||||
| 150 | + "sender_output_tokens": 512, | ||||
| 151 | + "sender_prefill_ms": 229.84720789827406, | ||||
| 152 | + "sender_ttft_ms": 12.01170904096216, | ||||
| 153 | + "sender_decode_ms": 6072.870207950473 | ||||
| 154 | + }, | ||||
| 155 | + "repair": { | ||||
| 156 | + "lookups": 0, | ||||
| 157 | + "fetched_bytes": 0 | ||||
| 158 | + }, | ||||
| 159 | + "ledger": { | ||||
| 160 | + "facts_total": 66, | ||||
| 161 | + "facts_retained": 21, | ||||
| 162 | + "retention_rate": 0.3181818181818182, | ||||
| 163 | + "retention_by_kind": { | ||||
| 164 | + "person": 0.5, | ||||
| 165 | + "date": 0.0, | ||||
| 166 | + "amount": 0.35294117647058826, | ||||
| 167 | + "status": 0.5, | ||||
| 168 | + "place": 0.0, | ||||
| 169 | + "identifier": 0.3333333333333333, | ||||
| 170 | + "quantity": 0.3333333333333333 | ||||
| 171 | + }, | ||||
| 172 | + "unsupported_numbers": 0, | ||||
| 173 | + "unsupported_identifiers": 0, | ||||
| 174 | + "distorted_sentences": 0, | ||||
| 175 | + "message_bytes": 1508 | ||||
| 176 | + } | ||||
| 177 | + }, | ||||
| 178 | + "6": { | ||||
| 179 | + "hop_ms": 6335.9819169854745, | ||||
| 180 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 181 | + "usage": { | ||||
| 182 | + "sender_input_tokens": 629, | ||||
| 183 | + "sender_output_tokens": 512, | ||||
| 184 | + "sender_prefill_ms": 229.3340830365196, | ||||
| 185 | + "sender_ttft_ms": 11.915999930351973, | ||||
| 186 | + "sender_decode_ms": 6093.903415952809 | ||||
| 187 | + }, | ||||
| 188 | + "repair": { | ||||
| 189 | + "lookups": 0, | ||||
| 190 | + "fetched_bytes": 0 | ||||
| 191 | + }, | ||||
| 192 | + "ledger": { | ||||
| 193 | + "facts_total": 66, | ||||
| 194 | + "facts_retained": 21, | ||||
| 195 | + "retention_rate": 0.3181818181818182, | ||||
| 196 | + "retention_by_kind": { | ||||
| 197 | + "person": 0.5, | ||||
| 198 | + "date": 0.0, | ||||
| 199 | + "amount": 0.35294117647058826, | ||||
| 200 | + "status": 0.5, | ||||
| 201 | + "place": 0.0, | ||||
| 202 | + "identifier": 0.3333333333333333, | ||||
| 203 | + "quantity": 0.3333333333333333 | ||||
| 204 | + }, | ||||
| 205 | + "unsupported_numbers": 0, | ||||
| 206 | + "unsupported_identifiers": 0, | ||||
| 207 | + "distorted_sentences": 0, | ||||
| 208 | + "message_bytes": 1508 | ||||
| 209 | + } | ||||
| 210 | + }, | ||||
| 211 | + "7": { | ||||
| 212 | + "hop_ms": 6312.74179101456, | ||||
| 213 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 214 | + "usage": { | ||||
| 215 | + "sender_input_tokens": 629, | ||||
| 216 | + "sender_output_tokens": 512, | ||||
| 217 | + "sender_prefill_ms": 229.2273750063032, | ||||
| 218 | + "sender_ttft_ms": 11.851499904878438, | ||||
| 219 | + "sender_decode_ms": 6070.791832986288 | ||||
| 220 | + }, | ||||
| 221 | + "repair": { | ||||
| 222 | + "lookups": 0, | ||||
| 223 | + "fetched_bytes": 0 | ||||
| 224 | + }, | ||||
| 225 | + "ledger": { | ||||
| 226 | + "facts_total": 66, | ||||
| 227 | + "facts_retained": 21, | ||||
| 228 | + "retention_rate": 0.3181818181818182, | ||||
| 229 | + "retention_by_kind": { | ||||
| 230 | + "person": 0.5, | ||||
| 231 | + "date": 0.0, | ||||
| 232 | + "amount": 0.35294117647058826, | ||||
| 233 | + "status": 0.5, | ||||
| 234 | + "place": 0.0, | ||||
| 235 | + "identifier": 0.3333333333333333, | ||||
| 236 | + "quantity": 0.3333333333333333 | ||||
| 237 | + }, | ||||
| 238 | + "unsupported_numbers": 0, | ||||
| 239 | + "unsupported_identifiers": 0, | ||||
| 240 | + "distorted_sentences": 0, | ||||
| 241 | + "message_bytes": 1508 | ||||
| 242 | + } | ||||
| 243 | + }, | ||||
| 244 | + "8": { | ||||
| 245 | + "hop_ms": 6337.379000033252, | ||||
| 246 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 247 | + "usage": { | ||||
| 248 | + "sender_input_tokens": 629, | ||||
| 249 | + "sender_output_tokens": 512, | ||||
| 250 | + "sender_prefill_ms": 229.24141702242196, | ||||
| 251 | + "sender_ttft_ms": 11.894540977664292, | ||||
| 252 | + "sender_decode_ms": 6095.427833031863 | ||||
| 253 | + }, | ||||
| 254 | + "repair": { | ||||
| 255 | + "lookups": 0, | ||||
| 256 | + "fetched_bytes": 0 | ||||
| 257 | + }, | ||||
| 258 | + "ledger": { | ||||
| 259 | + "facts_total": 66, | ||||
| 260 | + "facts_retained": 21, | ||||
| 261 | + "retention_rate": 0.3181818181818182, | ||||
| 262 | + "retention_by_kind": { | ||||
| 263 | + "person": 0.5, | ||||
| 264 | + "date": 0.0, | ||||
| 265 | + "amount": 0.35294117647058826, | ||||
| 266 | + "status": 0.5, | ||||
| 267 | + "place": 0.0, | ||||
| 268 | + "identifier": 0.3333333333333333, | ||||
| 269 | + "quantity": 0.3333333333333333 | ||||
| 270 | + }, | ||||
| 271 | + "unsupported_numbers": 0, | ||||
| 272 | + "unsupported_identifiers": 0, | ||||
| 273 | + "distorted_sentences": 0, | ||||
| 274 | + "message_bytes": 1508 | ||||
| 275 | + } | ||||
| 276 | + } | ||||
| 277 | + } | ||||
| 278 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03024_2000_A4_closed_qwen3b_llama3b.json
+278 −0
@@ -0,0 +1,278 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "**Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4", | ||||
| 4 | + "2": "**Faithful Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4 (amount not specified).\n (No further information available.)", | ||||
| 5 | + "3": "**Faithful Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget", | ||||
| 6 | + "4": "**Faithful Summary:**\n\nTwo proposed projects, **Quilun-16** and **Ostsel-4**, were discussed. \n\n**Quilun-16** was proposed by Bohdan Lindqvist on 16 Sep 2030 with an initial budget of 8,066,734 CAD. Budget revisions occurred on 16 Dec 2030 (9,134,435 CAD) and 7 Feb 2031 (8,946,145 CAD). The project was approved on 15 Feb 2031. The site is Lot 568-G, Mont-Laurier, and the supplier is BU-55G-3254. The rated capacity is 36.3 ha, with a calibration constant of 30.0224. The status is not cancelled but not postponed. Contingency reserves require written approval from the finance director. The project is reviewed quarterly and follows the three-quote rule for above threshold purchases. Capital expenditure is tracked separately from operating costs, and environmental monitoring reports are archived for 7 years. Printed copies are uncontrolled, with electronic records prevailing.\n\n**Ostsel-4** was proposed by Milos Rousseau on 7 Sep 2030 with an initial budget of 6,009,480 CAD. Budget revisions occurred on 26 Dec 2030 (5,453,600 CAD) and 7 Apr 2031 (5,628,235 CAD). The project was approved on 24 May 2031. The site is Lot 509-M, Mont-Laurier, and the supplier is CT-24D-4130. The rated capacity is 17.39 km, with a calibration constant of 41.3549. The status is not cancelled but postponed to 9 Jul 2031. The project is reviewed quarterly and follows the three-quote rule for above threshold purchases. Capital expenditure is tracked separately from operating costs, and environmental monitoring reports are archived for 7 years. Printed copies are uncontrolled, with electronic records prevailing.", | ||||
| 7 | + "5": "Two proposed projects, **Quilun-16** and **Ostsel-4**, were discussed. **Quilun-16** was proposed by Bohdan Lindqvist on 16 Sep 2030 with an initial budget of 8,066,734 CAD. Budget revisions occurred on 16 Dec 2030 (9,134,435 CAD) and 7 Feb 2031 (8,946,145 CAD). The project was approved on 15 Feb 2031. The site is Lot 568-G, Mont-Laurier, and the supplier is BU-55G-3254. The rated capacity is 36.3 ha, with a calibration constant of 30.0224. The status is not cancelled but not postponed. Contingency reserves require written approval from the finance director. The project is reviewed quarterly and follows the three-quote rule for above threshold purchases. Capital expenditure is tracked separately from operating costs, and environmental monitoring reports are archived for 7 years. Printed copies are uncontrolled, with electronic records prevailing. **Ostsel-4** was proposed by Milos Rousseau on 7 Sep 2030 with an initial budget of 6,009,480 CAD. Budget revisions occurred on 26 Dec 2030 (5,453,600 CAD) and 7 Apr 2031 (5,628,235 CAD). The project was approved on 24 May 2031. The site is Lot 509-M, Mont-Laurier, and the supplier is CT-24D-4130. The rated capacity is 17.39 km, with a calibration constant of 41.3549. The status is not cancelled but postponed to 9 Jul 2031. The project is reviewed quarterly and follows the three-quote rule for above threshold purchases. Capital expenditure is tracked separately from operating costs, and environmental monitoring reports are archived for 7 years. Printed copies are uncontrolled, with electronic records prevailing.", | ||||
| 8 | + "6": "Two proposed projects, **Quilun-16** and **Ostsel-4**, were discussed. **Quilun-16** was proposed by Bohdan Lindqvist on 16 Sep 2030 with an initial budget of 8,066,734 CAD. Budget revisions occurred on 16 Dec 2030 (9,134,435 CAD) and 7 Feb 2031 (8,946,145 CAD). The project was approved on 15 Feb 2031. The site is Lot 568-G, Mont-Laurier, and the supplier is BU-55G-3254. The rated capacity is 36.3 ha, with a calibration constant of 30.0224. The status of **Quilun-16** is not cancelled but not postponed. Contingency reserves require written approval from the finance director. The project is reviewed quarterly and follows the three-quote rule for above threshold purchases. Capital expenditure is tracked separately from operating costs, and environmental monitoring reports are archived for 7 years. Printed copies are uncontrolled, with electronic records prevailing.\n\n**Ostsel-4** was proposed by Milos Rousseau on 7 Sep 2030 with an initial budget of 6,009,480 CAD. Budget revisions occurred on 26 Dec 2030 (5,453,600 CAD) and 7 Apr 2031 (5,628,235 CAD). The project was approved on 24 May 2031. The site is Lot 509-M, Mont-Laurier, and the supplier is CT-24D-4130. The rated capacity is 17.39 km, with a calibration constant of 41.3549. The status of **Ostsel-4** is not cancelled but postponed to 9 Jul 2031. The project is reviewed quarterly and follows the three-quote rule for above threshold purchases. Capital expenditure is tracked separately from operating costs, and environmental monitoring reports are archived for 7 years. Printed copies are uncontrolled, with electronic records prevailing.", | ||||
| 9 | + "7": "Two proposed projects, **Quilun-16** and **Ostsel-4**, were discussed. **Quilun-16** was proposed by Bohdan Lindqvist on 16 Sep 2030 with an initial budget of 8,066,734 CAD. Budget revisions occurred on 16 Dec 2030 (9,134,435 CAD) and 7 Feb 2031 (8,946,145 CAD). The project was approved on 15 Feb 2031. The site is Lot 568-G, Mont-Laurier, and the supplier is BU-55G-3254. The rated capacity is 36.3 ha, with a calibration constant of 30.0224. The status is not cancelled but not postponed. Contingency reserves require written approval from the finance director. Quarterly reviews follow the three-quote rule for above threshold purchases. Capital expenditure is tracked separately from operating costs, and environmental monitoring reports are archived for 7 years. Printed copies are uncontrolled, with electronic records prevailing.\n\n**Ostsel-4** was proposed by Milos Rousseau on 7 Sep 2030 with an initial budget of 6,009,480 CAD. Budget revisions occurred on 26 Dec 2030 (5,453,600 CAD) and 7 Apr 2031 (5,628,235 CAD). The project was approved on 24 May 2031. The site is Lot 509-M, Mont-Laurier, and the supplier is CT-24D-4130. The rated capacity is 17.39 km, with a calibration constant of 41.3549. The status is not cancelled but postponed to 9 Jul 2031. Quarterly reviews follow the three-quote rule for above threshold purchases. Capital expenditure is tracked separately from operating costs, and environmental monitoring reports are archived for 7 years. Printed copies are uncontrolled, with electronic records prevailing.", | ||||
| 10 | + "8": "Two proposed projects, **Quilun-16** and **Ostsel-4**, were discussed. **Quilun-16** was proposed by Bohdan Lindqvist on 16 Sep 2030 with an initial budget of 8,066,734 CAD. Budget revisions occurred on 16 Dec 2030 (9,134,435 CAD) and 7 Feb 2031 (8,946,145 CAD). The project was approved on 15 Feb 2031. The site is Lot 568-G, Mont-Laurier, and the supplier is BU-55G-3254. The rated capacity is 36.3 ha, with a calibration constant of 30.0224. The status of **Quilun-16** is not cancelled but not postponed. Contingency reserves require written approval from the finance director. Quarterly reviews follow the three-quote rule for above threshold purchases. Capital expenditure is tracked separately from operating costs, and environmental monitoring reports are archived for 7 years. Printed copies are uncontrolled, with electronic records prevailing.\n\n**Ostsel-4** was proposed by Milos Rousseau on 7 Sep 2030 with an initial budget of 6,009,480 CAD. Budget revisions occurred on 26 Dec 2030 (5,453,600 CAD) and 7 Apr 2031 (5,628,235 CAD). The project was approved on 24 May 2031. The site is Lot 509-M, Mont-Laurier, and the supplier is CT-24D-4130. The rated capacity is 17.39 km, with a calibration constant of 41.3549. The status of **Ostsel-4** is not cancelled but postponed to 9 Jul 2031. Quarterly reviews follow the three-quote rule for above threshold purchases. Capital expenditure is tracked separately from operating costs, and environmental monitoring reports are archived for 7 years. Printed copies are uncontrolled, with electronic records prevailing." | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6944.753459072672, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2184, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 776.4430840034038, | ||||
| 20 | + "sender_ttft_ms": 12.212041998282075, | ||||
| 21 | + "sender_decode_ms": 6153.939125011675 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 66, | ||||
| 29 | + "facts_retained": 21, | ||||
| 30 | + "retention_rate": 0.3181818181818182, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.5, | ||||
| 33 | + "date": 0.0, | ||||
| 34 | + "amount": 0.35294117647058826, | ||||
| 35 | + "status": 0.5, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.3333333333333333, | ||||
| 38 | + "quantity": 0.3333333333333333 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 1508 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 5560.2366250241175, | ||||
| 48 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 578, | ||||
| 51 | + "sender_output_tokens": 456, | ||||
| 52 | + "sender_prefill_ms": 237.1407919563353, | ||||
| 53 | + "sender_ttft_ms": 11.845875065773726, | ||||
| 54 | + "sender_decode_ms": 5310.2846660185605 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 0, | ||||
| 58 | + "fetched_bytes": 0 | ||||
| 59 | + }, | ||||
| 60 | + "ledger": { | ||||
| 61 | + "facts_total": 66, | ||||
| 62 | + "facts_retained": 21, | ||||
| 63 | + "retention_rate": 0.3181818181818182, | ||||
| 64 | + "retention_by_kind": { | ||||
| 65 | + "person": 0.5, | ||||
| 66 | + "date": 0.0, | ||||
| 67 | + "amount": 0.35294117647058826, | ||||
| 68 | + "status": 0.5, | ||||
| 69 | + "place": 0.0, | ||||
| 70 | + "identifier": 0.3333333333333333, | ||||
| 71 | + "quantity": 0.3333333333333333 | ||||
| 72 | + }, | ||||
| 73 | + "unsupported_numbers": 0, | ||||
| 74 | + "unsupported_identifiers": 0, | ||||
| 75 | + "distorted_sentences": 0, | ||||
| 76 | + "message_bytes": 1579 | ||||
| 77 | + } | ||||
| 78 | + }, | ||||
| 79 | + "3": { | ||||
| 80 | + "hop_ms": 6389.902791008353, | ||||
| 81 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 82 | + "usage": { | ||||
| 83 | + "sender_input_tokens": 643, | ||||
| 84 | + "sender_output_tokens": 512, | ||||
| 85 | + "sender_prefill_ms": 252.3624999448657, | ||||
| 86 | + "sender_ttft_ms": 12.331957928836346, | ||||
| 87 | + "sender_decode_ms": 6124.311084044166 | ||||
| 88 | + }, | ||||
| 89 | + "repair": { | ||||
| 90 | + "lookups": 0, | ||||
| 91 | + "fetched_bytes": 0 | ||||
| 92 | + }, | ||||
| 93 | + "ledger": { | ||||
| 94 | + "facts_total": 66, | ||||
| 95 | + "facts_retained": 21, | ||||
| 96 | + "retention_rate": 0.3181818181818182, | ||||
| 97 | + "retention_by_kind": { | ||||
| 98 | + "person": 0.5, | ||||
| 99 | + "date": 0.0, | ||||
| 100 | + "amount": 0.35294117647058826, | ||||
| 101 | + "status": 0.5, | ||||
| 102 | + "place": 0.0, | ||||
| 103 | + "identifier": 0.3333333333333333, | ||||
| 104 | + "quantity": 0.3333333333333333 | ||||
| 105 | + }, | ||||
| 106 | + "unsupported_numbers": 0, | ||||
| 107 | + "unsupported_identifiers": 0, | ||||
| 108 | + "distorted_sentences": 0, | ||||
| 109 | + "message_bytes": 1514 | ||||
| 110 | + } | ||||
| 111 | + }, | ||||
| 112 | + "4": { | ||||
| 113 | + "hop_ms": 5023.429375025444, | ||||
| 114 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 115 | + "usage": { | ||||
| 116 | + "sender_input_tokens": 578, | ||||
| 117 | + "sender_output_tokens": 411, | ||||
| 118 | + "sender_prefill_ms": 236.27604206558317, | ||||
| 119 | + "sender_ttft_ms": 11.853707954287529, | ||||
| 120 | + "sender_decode_ms": 4774.381541996263 | ||||
| 121 | + }, | ||||
| 122 | + "repair": { | ||||
| 123 | + "lookups": 0, | ||||
| 124 | + "fetched_bytes": 0 | ||||
| 125 | + }, | ||||
| 126 | + "ledger": { | ||||
| 127 | + "facts_total": 66, | ||||
| 128 | + "facts_retained": 20, | ||||
| 129 | + "retention_rate": 0.30303030303030304, | ||||
| 130 | + "retention_by_kind": { | ||||
| 131 | + "person": 0.3333333333333333, | ||||
| 132 | + "date": 0.0, | ||||
| 133 | + "amount": 0.35294117647058826, | ||||
| 134 | + "status": 0.5, | ||||
| 135 | + "place": 0.0, | ||||
| 136 | + "identifier": 0.3333333333333333, | ||||
| 137 | + "quantity": 0.3333333333333333 | ||||
| 138 | + }, | ||||
| 139 | + "unsupported_numbers": 0, | ||||
| 140 | + "unsupported_identifiers": 0, | ||||
| 141 | + "distorted_sentences": 0, | ||||
| 142 | + "message_bytes": 1606 | ||||
| 143 | + } | ||||
| 144 | + }, | ||||
| 145 | + "5": { | ||||
| 146 | + "hop_ms": 5870.618999935687, | ||||
| 147 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 148 | + "usage": { | ||||
| 149 | + "sender_input_tokens": 595, | ||||
| 150 | + "sender_output_tokens": 471, | ||||
| 151 | + "sender_prefill_ms": 231.8142909789458, | ||||
| 152 | + "sender_ttft_ms": 12.021500035189092, | ||||
| 153 | + "sender_decode_ms": 5625.946082989685 | ||||
| 154 | + }, | ||||
| 155 | + "repair": { | ||||
| 156 | + "lookups": 0, | ||||
| 157 | + "fetched_bytes": 0 | ||||
| 158 | + }, | ||||
| 159 | + "ledger": { | ||||
| 160 | + "facts_total": 66, | ||||
| 161 | + "facts_retained": 20, | ||||
| 162 | + "retention_rate": 0.30303030303030304, | ||||
| 163 | + "retention_by_kind": { | ||||
| 164 | + "person": 0.3333333333333333, | ||||
| 165 | + "date": 0.0, | ||||
| 166 | + "amount": 0.35294117647058826, | ||||
| 167 | + "status": 0.5, | ||||
| 168 | + "place": 0.0, | ||||
| 169 | + "identifier": 0.3333333333333333, | ||||
| 170 | + "quantity": 0.3333333333333333 | ||||
| 171 | + }, | ||||
| 172 | + "unsupported_numbers": 0, | ||||
| 173 | + "unsupported_identifiers": 0, | ||||
| 174 | + "distorted_sentences": 0, | ||||
| 175 | + "message_bytes": 1580 | ||||
| 176 | + } | ||||
| 177 | + }, | ||||
| 178 | + "6": { | ||||
| 179 | + "hop_ms": 5081.656874972396, | ||||
| 180 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 181 | + "usage": { | ||||
| 182 | + "sender_input_tokens": 539, | ||||
| 183 | + "sender_output_tokens": 419, | ||||
| 184 | + "sender_prefill_ms": 216.23074996750802, | ||||
| 185 | + "sender_ttft_ms": 11.661291006021202, | ||||
| 186 | + "sender_decode_ms": 4852.9370409669355 | ||||
| 187 | + }, | ||||
| 188 | + "repair": { | ||||
| 189 | + "lookups": 0, | ||||
| 190 | + "fetched_bytes": 0 | ||||
| 191 | + }, | ||||
| 192 | + "ledger": { | ||||
| 193 | + "facts_total": 66, | ||||
| 194 | + "facts_retained": 20, | ||||
| 195 | + "retention_rate": 0.30303030303030304, | ||||
| 196 | + "retention_by_kind": { | ||||
| 197 | + "person": 0.3333333333333333, | ||||
| 198 | + "date": 0.0, | ||||
| 199 | + "amount": 0.35294117647058826, | ||||
| 200 | + "status": 0.5, | ||||
| 201 | + "place": 0.0, | ||||
| 202 | + "identifier": 0.3333333333333333, | ||||
| 203 | + "quantity": 0.3333333333333333 | ||||
| 204 | + }, | ||||
| 205 | + "unsupported_numbers": 0, | ||||
| 206 | + "unsupported_identifiers": 0, | ||||
| 207 | + "distorted_sentences": 0, | ||||
| 208 | + "message_bytes": 1614 | ||||
| 209 | + } | ||||
| 210 | + }, | ||||
| 211 | + "7": { | ||||
| 212 | + "hop_ms": 5788.924874970689, | ||||
| 213 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 214 | + "usage": { | ||||
| 215 | + "sender_input_tokens": 604, | ||||
| 216 | + "sender_output_tokens": 463, | ||||
| 217 | + "sender_prefill_ms": 231.85075004585087, | ||||
| 218 | + "sender_ttft_ms": 12.09741597995162, | ||||
| 219 | + "sender_decode_ms": 5544.0642080502585 | ||||
| 220 | + }, | ||||
| 221 | + "repair": { | ||||
| 222 | + "lookups": 0, | ||||
| 223 | + "fetched_bytes": 0 | ||||
| 224 | + }, | ||||
| 225 | + "ledger": { | ||||
| 226 | + "facts_total": 66, | ||||
| 227 | + "facts_retained": 20, | ||||
| 228 | + "retention_rate": 0.30303030303030304, | ||||
| 229 | + "retention_by_kind": { | ||||
| 230 | + "person": 0.3333333333333333, | ||||
| 231 | + "date": 0.0, | ||||
| 232 | + "amount": 0.35294117647058826, | ||||
| 233 | + "status": 0.5, | ||||
| 234 | + "place": 0.0, | ||||
| 235 | + "identifier": 0.3333333333333333, | ||||
| 236 | + "quantity": 0.3333333333333333 | ||||
| 237 | + }, | ||||
| 238 | + "unsupported_numbers": 0, | ||||
| 239 | + "unsupported_identifiers": 0, | ||||
| 240 | + "distorted_sentences": 0, | ||||
| 241 | + "message_bytes": 1539 | ||||
| 242 | + } | ||||
| 243 | + }, | ||||
| 244 | + "8": { | ||||
| 245 | + "hop_ms": 4986.825458006933, | ||||
| 246 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 247 | + "usage": { | ||||
| 248 | + "sender_input_tokens": 531, | ||||
| 249 | + "sender_output_tokens": 411, | ||||
| 250 | + "sender_prefill_ms": 217.0411670813337, | ||||
| 251 | + "sender_ttft_ms": 11.632374953478575, | ||||
| 252 | + "sender_decode_ms": 4757.300416938961 | ||||
| 253 | + }, | ||||
| 254 | + "repair": { | ||||
| 255 | + "lookups": 0, | ||||
| 256 | + "fetched_bytes": 0 | ||||
| 257 | + }, | ||||
| 258 | + "ledger": { | ||||
| 259 | + "facts_total": 66, | ||||
| 260 | + "facts_retained": 20, | ||||
| 261 | + "retention_rate": 0.30303030303030304, | ||||
| 262 | + "retention_by_kind": { | ||||
| 263 | + "person": 0.3333333333333333, | ||||
| 264 | + "date": 0.0, | ||||
| 265 | + "amount": 0.35294117647058826, | ||||
| 266 | + "status": 0.5, | ||||
| 267 | + "place": 0.0, | ||||
| 268 | + "identifier": 0.3333333333333333, | ||||
| 269 | + "quantity": 0.3333333333333333 | ||||
| 270 | + }, | ||||
| 271 | + "unsupported_numbers": 0, | ||||
| 272 | + "unsupported_identifiers": 0, | ||||
| 273 | + "distorted_sentences": 0, | ||||
| 274 | + "message_bytes": 1572 | ||||
| 275 | + } | ||||
| 276 | + } | ||||
| 277 | + } | ||||
| 278 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03024_2000_A4_repairable_qwen3b.json
+285 −0
@@ -0,0 +1,285 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "**Summary:**\n\n- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4", | ||||
| 4 | + "2": "- **Quilun-16:**\n - Proposed by Bohdan Lindqvist on 16 Sep 2030.\n - Initial budget: 8,066,734 CAD.\n - Budget revisions: 16 Dec 2030 (9,134,435 CAD), 7 Feb 2031 (8,946,145 CAD).\n - Approved on 15 Feb 2031.\n - Site: Lot 568-G, Mont-Laurier.\n - Supplier: BU-55G-3254.\n - Rated capacity: 36.3 ha.\n - Calibration constant: 30.0224.\n - Status: Not cancelled, but not postponed.\n - Contingency reserves require written approval from finance director.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Ostsel-4:**\n - Proposed by Milos Rousseau on 7 Sep 2030.\n - Initial budget: 6,009,480 CAD.\n - Budget revisions: 26 Dec 2030 (5,453,600 CAD), 7 Apr 2031 (5,628,235 CAD).\n - Approved on 24 May 2031.\n - Site: Lot 509-M, Mont-Laurier.\n - Supplier: CT-24D-4130.\n - Rated capacity: 17.39 km.\n - Calibration constant: 41.3549.\n - Status: Not cancelled, but postponed to 9 Jul 2031.\n - Reviewed quarterly.\n - Procurement follows three-quote rule for above threshold purchases.\n - Capital expenditure tracked separately from operating costs.\n - Environmental monitoring reports archived for 7 years.\n - Printed copies uncontrolled; electronic record prevails.\n\n- **Quidra-11:**\n - Proposed by Casimir Lindqvist on 11 Apr 2030.\n - Initial budget: 4,234", | ||||
| 5 | + "3": "Quilun-16: Proposed by Bohdan Lindqvist on 16 Sep 2030 with an initial budget of 8,066,734 CAD. Budget revised to 9,134,435 CAD on 16 Dec 2030 and to 8,946,145 CAD on 7 Feb 2031. Approved on 15 Feb 2031. Site: Lot 568-G, Mont-Laurier. Supplier: BU-55G-3254. Rated capacity: 36.3 ha. Calibration constant: 30.0224. Status: Not cancelled, but not postponed. Contingency reserves require finance director approval. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nOstsel-4: Proposed by Milos Rousseau on 7 Sep 2030 with an initial budget of 6,009,480 CAD. Budget revised to 5,453,600 CAD on 26 Dec 2030 and to 5,628,235 CAD on 7 Apr 2031. Approved on 24 May 2031. Site: Lot 509-M, Mont-Laurier. Supplier: CT-24D-4130. Rated capacity: 17.39 km. Calibration constant: 41.3549. Status: Not cancelled, but postponed to 9 Jul 2031. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nQuidra-11: Proposed by Casimir Lindqvist on 11 Apr 2030 with an initial budget of 4,234,000 CAD. Status: Not provided. No other details.", | ||||
| 6 | + "4": "Quilun-16: Proposed by Bohdan Lindqvist on 16 Sep 2030 with an initial budget of 8,066,734 CAD. Budget revised to 9,134,435 CAD on 16 Dec 2030 and to 8,946,145 CAD on 7 Feb 2031. Approved on 15 Feb 2031. Site: Lot 568-G, Mont-Laurier. Supplier: BU-55G-3254. Rated capacity: 36.3 ha. Calibration constant: 30.0224. Status: Not cancelled, but not postponed. Contingency reserves require finance director approval. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nOstsel-4: Proposed by Milos Rousseau on 7 Sep 2030 with an initial budget of 6,009,480 CAD. Budget revised to 5,453,600 CAD on 26 Dec 2030 and to 5,628,235 CAD on 7 Apr 2031. Approved on 24 May 2031. Site: Lot 509-M, Mont-Laurier. Supplier: CT-24D-4130. Rated capacity: 17.39 km. Calibration constant: 41.3549. Status: Not cancelled, but postponed to 9 Jul 2031. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nQuidra-11: Proposed by Casimir Lindqvist on 11 Apr 2030 with an initial budget of 4,234,000 CAD. Status: Not provided. No other details.", | ||||
| 7 | + "5": "Quilun-16: Proposed by Bohdan Lindqvist on 16 Sep 2030 with an initial budget of 8,066,734 CAD. Budget revised to 9,134,435 CAD on 16 Dec 2030 and to 8,946,145 CAD on 7 Feb 2031. Approved on 15 Feb 2031. Site: Lot 568-G, Mont-Laurier. Supplier: BU-55G-3254. Rated capacity: 36.3 ha. Calibration constant: 30.0224. Status: Not cancelled, but not postponed. Contingency reserves require finance director approval. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nOstsel-4: Proposed by Milos Rousseau on 7 Sep 2030 with an initial budget of 6,009,480 CAD. Budget revised to 5,453,600 CAD on 26 Dec 2030 and to 5,628,235 CAD on 7 Apr 2031. Approved on 24 May 2031. Site: Lot 509-M, Mont-Laurier. Supplier: CT-24D-4130. Rated capacity: 17.39 km. Calibration constant: 41.3549. Status: Not cancelled, but postponed to 9 Jul 2031. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nQuidra-11: Proposed by Casimir Lindqvist on 11 Apr 2030 with an initial budget of 4,234,000 CAD. Status: Not provided. No other details.", | ||||
| 8 | + "6": "Quilun-16: Proposed by Bohdan Lindqvist on 16 Sep 2030 with an initial budget of 8,066,734 CAD. Budget revised to 9,134,435 CAD on 16 Dec 2030 and to 8,946,145 CAD on 7 Feb 2031. Approved on 15 Feb 2031. Site: Lot 568-G, Mont-Laurier. Supplier: BU-55G-3254. Rated capacity: 36.3 ha. Calibration constant: 30.0224. Status: Not cancelled, but not postponed. Contingency reserves require finance director approval. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nOstsel-4: Proposed by Milos Rousseau on 7 Sep 2030 with an initial budget of 6,009,480 CAD. Budget revised to 5,453,600 CAD on 26 Dec 2030 and to 5,628,235 CAD on 7 Apr 2031. Approved on 24 May 2031. Site: Lot 509-M, Mont-Laurier. Supplier: CT-24D-4130. Rated capacity: 17.39 km. Calibration constant: 41.3549. Status: Not cancelled, but postponed to 9 Jul 2031. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nQuidra-11: Proposed by Casimir Lindqvist on 11 Apr 2030 with an initial budget of 4,234,000 CAD. Status: Not provided. No other details.", | ||||
| 9 | + "7": "Quilun-16: Proposed by Bohdan Lindqvist on 16 Sep 2030 with an initial budget of 8,066,734 CAD. Budget revised to 9,134,435 CAD on 16 Dec 2030 and to 8,946,145 CAD on 7 Feb 2031. Approved on 15 Feb 2031. Site: Lot 568-G, Mont-Laurier. Supplier: BU-55G-3254. Rated capacity: 36.3 ha. Calibration constant: 30.0224. Status: Not cancelled, but not postponed. Contingency reserves require finance director approval. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nOstsel-4: Proposed by Milos Rousseau on 7 Sep 2030 with an initial budget of 6,009,480 CAD. Budget revised to 5,453,600 CAD on 26 Dec 2030 and to 5,628,235 CAD on 7 Apr 2031. Approved on 24 May 2031. Site: Lot 509-M, Mont-Laurier. Supplier: CT-24D-4130. Rated capacity: 17.39 km. Calibration constant: 41.3549. Status: Not cancelled, but postponed to 9 Jul 2031. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nQuidra-11: Proposed by Casimir Lindqvist on 11 Apr 2030 with an initial budget of 4,234,000 CAD. Status: Not provided. No other details.", | ||||
| 10 | + "8": "Quilun-16: Proposed by Bohdan Lindqvist on 16 Sep 2030 with an initial budget of 8,066,734 CAD. Budget revised to 9,134,435 CAD on 16 Dec 2030 and to 8,946,145 CAD on 7 Feb 2031. Approved on 15 Feb 2031. Site: Lot 568-G, Mont-Laurier. Supplier: BU-55G-3254. Rated capacity: 36.3 ha. Calibration constant: 30.0224. Status: Not cancelled, but not postponed. Contingency reserves require finance director approval. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nOstsel-4: Proposed by Milos Rousseau on 7 Sep 2030 with an initial budget of 6,009,480 CAD. Budget revised to 5,453,600 CAD on 26 Dec 2030 and to 5,628,235 CAD on 7 Apr 2031. Approved on 24 May 2031. Site: Lot 509-M, Mont-Laurier. Supplier: CT-24D-4130. Rated capacity: 17.39 km. Calibration constant: 41.3549. Status: Not cancelled, but postponed to 9 Jul 2031. Reviewed quarterly. Procurement follows three-quote rule for above threshold purchases. Capital expenditure tracked separately from operating costs. Environmental monitoring reports archived for 7 years. Printed copies uncontrolled; electronic record prevails.\n\nQuidra-11: Proposed by Casimir Lindqvist on 11 Apr 2030 with an initial budget of 4,234,000 CAD. Status: Not provided. No other details." | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6945.187625009567, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2184, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 777.0795000251383, | ||||
| 20 | + "sender_ttft_ms": 12.172042042948306, | ||||
| 21 | + "sender_decode_ms": 6153.865125030279 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 66, | ||||
| 29 | + "facts_retained": 21, | ||||
| 30 | + "retention_rate": 0.3181818181818182, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.5, | ||||
| 33 | + "date": 0.0, | ||||
| 34 | + "amount": 0.35294117647058826, | ||||
| 35 | + "status": 0.5, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.3333333333333333, | ||||
| 38 | + "quantity": 0.3333333333333333 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 1508 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 6529.009124962613, | ||||
| 48 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 1108, | ||||
| 51 | + "sender_output_tokens": 512, | ||||
| 52 | + "sender_prefill_ms": 399.13929195608944, | ||||
| 53 | + "sender_ttft_ms": 12.24833307787776, | ||||
| 54 | + "sender_decode_ms": 6116.40262498986 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 2, | ||||
| 58 | + "fetched_bytes": 1169, | ||||
| 59 | + "codes_mentioned": 3 | ||||
| 60 | + }, | ||||
| 61 | + "ledger": { | ||||
| 62 | + "facts_total": 66, | ||||
| 63 | + "facts_retained": 21, | ||||
| 64 | + "retention_rate": 0.3181818181818182, | ||||
| 65 | + "retention_by_kind": { | ||||
| 66 | + "person": 0.5, | ||||
| 67 | + "date": 0.0, | ||||
| 68 | + "amount": 0.35294117647058826, | ||||
| 69 | + "status": 0.5, | ||||
| 70 | + "place": 0.0, | ||||
| 71 | + "identifier": 0.3333333333333333, | ||||
| 72 | + "quantity": 0.3333333333333333 | ||||
| 73 | + }, | ||||
| 74 | + "unsupported_numbers": 1, | ||||
| 75 | + "unsupported_identifiers": 0, | ||||
| 76 | + "distorted_sentences": 0, | ||||
| 77 | + "message_bytes": 1498 | ||||
| 78 | + } | ||||
| 79 | + }, | ||||
| 80 | + "3": { | ||||
| 81 | + "hop_ms": 5943.714833003469, | ||||
| 82 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 83 | + "usage": { | ||||
| 84 | + "sender_input_tokens": 1108, | ||||
| 85 | + "sender_output_tokens": 463, | ||||
| 86 | + "sender_prefill_ms": 399.0637499373406, | ||||
| 87 | + "sender_ttft_ms": 12.662250082939863, | ||||
| 88 | + "sender_decode_ms": 5530.745416996069 | ||||
| 89 | + }, | ||||
| 90 | + "repair": { | ||||
| 91 | + "lookups": 2, | ||||
| 92 | + "fetched_bytes": 1169, | ||||
| 93 | + "codes_mentioned": 3 | ||||
| 94 | + }, | ||||
| 95 | + "ledger": { | ||||
| 96 | + "facts_total": 66, | ||||
| 97 | + "facts_retained": 21, | ||||
| 98 | + "retention_rate": 0.3181818181818182, | ||||
| 99 | + "retention_by_kind": { | ||||
| 100 | + "person": 0.5, | ||||
| 101 | + "date": 0.0, | ||||
| 102 | + "amount": 0.35294117647058826, | ||||
| 103 | + "status": 0.5, | ||||
| 104 | + "place": 0.0, | ||||
| 105 | + "identifier": 0.3333333333333333, | ||||
| 106 | + "quantity": 0.3333333333333333 | ||||
| 107 | + }, | ||||
| 108 | + "unsupported_numbers": 1, | ||||
| 109 | + "unsupported_identifiers": 0, | ||||
| 110 | + "distorted_sentences": 1, | ||||
| 111 | + "message_bytes": 1435 | ||||
| 112 | + } | ||||
| 113 | + }, | ||||
| 114 | + "4": { | ||||
| 115 | + "hop_ms": 5912.973375059664, | ||||
| 116 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 117 | + "usage": { | ||||
| 118 | + "sender_input_tokens": 1058, | ||||
| 119 | + "sender_output_tokens": 463, | ||||
| 120 | + "sender_prefill_ms": 379.84920805320144, | ||||
| 121 | + "sender_ttft_ms": 11.934916954487562, | ||||
| 122 | + "sender_decode_ms": 5519.934375071898 | ||||
| 123 | + }, | ||||
| 124 | + "repair": { | ||||
| 125 | + "lookups": 2, | ||||
| 126 | + "fetched_bytes": 1169, | ||||
| 127 | + "codes_mentioned": 3 | ||||
| 128 | + }, | ||||
| 129 | + "ledger": { | ||||
| 130 | + "facts_total": 66, | ||||
| 131 | + "facts_retained": 21, | ||||
| 132 | + "retention_rate": 0.3181818181818182, | ||||
| 133 | + "retention_by_kind": { | ||||
| 134 | + "person": 0.5, | ||||
| 135 | + "date": 0.0, | ||||
| 136 | + "amount": 0.35294117647058826, | ||||
| 137 | + "status": 0.5, | ||||
| 138 | + "place": 0.0, | ||||
| 139 | + "identifier": 0.3333333333333333, | ||||
| 140 | + "quantity": 0.3333333333333333 | ||||
| 141 | + }, | ||||
| 142 | + "unsupported_numbers": 1, | ||||
| 143 | + "unsupported_identifiers": 0, | ||||
| 144 | + "distorted_sentences": 1, | ||||
| 145 | + "message_bytes": 1435 | ||||
| 146 | + } | ||||
| 147 | + }, | ||||
| 148 | + "5": { | ||||
| 149 | + "hop_ms": 5908.367124968208, | ||||
| 150 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 151 | + "usage": { | ||||
| 152 | + "sender_input_tokens": 1058, | ||||
| 153 | + "sender_output_tokens": 463, | ||||
| 154 | + "sender_prefill_ms": 378.9750839350745, | ||||
| 155 | + "sender_ttft_ms": 11.918041040189564, | ||||
| 156 | + "sender_decode_ms": 5516.354832914658 | ||||
| 157 | + }, | ||||
| 158 | + "repair": { | ||||
| 159 | + "lookups": 2, | ||||
| 160 | + "fetched_bytes": 1169, | ||||
| 161 | + "codes_mentioned": 3 | ||||
| 162 | + }, | ||||
| 163 | + "ledger": { | ||||
| 164 | + "facts_total": 66, | ||||
| 165 | + "facts_retained": 21, | ||||
| 166 | + "retention_rate": 0.3181818181818182, | ||||
| 167 | + "retention_by_kind": { | ||||
| 168 | + "person": 0.5, | ||||
| 169 | + "date": 0.0, | ||||
| 170 | + "amount": 0.35294117647058826, | ||||
| 171 | + "status": 0.5, | ||||
| 172 | + "place": 0.0, | ||||
| 173 | + "identifier": 0.3333333333333333, | ||||
| 174 | + "quantity": 0.3333333333333333 | ||||
| 175 | + }, | ||||
| 176 | + "unsupported_numbers": 1, | ||||
| 177 | + "unsupported_identifiers": 0, | ||||
| 178 | + "distorted_sentences": 1, | ||||
| 179 | + "message_bytes": 1435 | ||||
| 180 | + } | ||||
| 181 | + }, | ||||
| 182 | + "6": { | ||||
| 183 | + "hop_ms": 5911.119500058703, | ||||
| 184 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 185 | + "usage": { | ||||
| 186 | + "sender_input_tokens": 1058, | ||||
| 187 | + "sender_output_tokens": 463, | ||||
| 188 | + "sender_prefill_ms": 379.9659579526633, | ||||
| 189 | + "sender_ttft_ms": 11.911666952073574, | ||||
| 190 | + "sender_decode_ms": 5518.029708066024 | ||||
| 191 | + }, | ||||
| 192 | + "repair": { | ||||
| 193 | + "lookups": 2, | ||||
| 194 | + "fetched_bytes": 1169, | ||||
| 195 | + "codes_mentioned": 3 | ||||
| 196 | + }, | ||||
| 197 | + "ledger": { | ||||
| 198 | + "facts_total": 66, | ||||
| 199 | + "facts_retained": 21, | ||||
| 200 | + "retention_rate": 0.3181818181818182, | ||||
| 201 | + "retention_by_kind": { | ||||
| 202 | + "person": 0.5, | ||||
| 203 | + "date": 0.0, | ||||
| 204 | + "amount": 0.35294117647058826, | ||||
| 205 | + "status": 0.5, | ||||
| 206 | + "place": 0.0, | ||||
| 207 | + "identifier": 0.3333333333333333, | ||||
| 208 | + "quantity": 0.3333333333333333 | ||||
| 209 | + }, | ||||
| 210 | + "unsupported_numbers": 1, | ||||
| 211 | + "unsupported_identifiers": 0, | ||||
| 212 | + "distorted_sentences": 1, | ||||
| 213 | + "message_bytes": 1435 | ||||
| 214 | + } | ||||
| 215 | + }, | ||||
| 216 | + "7": { | ||||
| 217 | + "hop_ms": 5908.995958045125, | ||||
| 218 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 219 | + "usage": { | ||||
| 220 | + "sender_input_tokens": 1058, | ||||
| 221 | + "sender_output_tokens": 463, | ||||
| 222 | + "sender_prefill_ms": 379.4300000881776, | ||||
| 223 | + "sender_ttft_ms": 11.855041957460344, | ||||
| 224 | + "sender_decode_ms": 5516.471749986522 | ||||
| 225 | + }, | ||||
| 226 | + "repair": { | ||||
| 227 | + "lookups": 2, | ||||
| 228 | + "fetched_bytes": 1169, | ||||
| 229 | + "codes_mentioned": 3 | ||||
| 230 | + }, | ||||
| 231 | + "ledger": { | ||||
| 232 | + "facts_total": 66, | ||||
| 233 | + "facts_retained": 21, | ||||
| 234 | + "retention_rate": 0.3181818181818182, | ||||
| 235 | + "retention_by_kind": { | ||||
| 236 | + "person": 0.5, | ||||
| 237 | + "date": 0.0, | ||||
| 238 | + "amount": 0.35294117647058826, | ||||
| 239 | + "status": 0.5, | ||||
| 240 | + "place": 0.0, | ||||
| 241 | + "identifier": 0.3333333333333333, | ||||
| 242 | + "quantity": 0.3333333333333333 | ||||
| 243 | + }, | ||||
| 244 | + "unsupported_numbers": 1, | ||||
| 245 | + "unsupported_identifiers": 0, | ||||
| 246 | + "distorted_sentences": 1, | ||||
| 247 | + "message_bytes": 1435 | ||||
| 248 | + } | ||||
| 249 | + }, | ||||
| 250 | + "8": { | ||||
| 251 | + "hop_ms": 5903.457792010158, | ||||
| 252 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 253 | + "usage": { | ||||
| 254 | + "sender_input_tokens": 1058, | ||||
| 255 | + "sender_output_tokens": 463, | ||||
| 256 | + "sender_prefill_ms": 379.22308302950114, | ||||
| 257 | + "sender_ttft_ms": 11.939875083044171, | ||||
| 258 | + "sender_decode_ms": 5511.089207953773 | ||||
| 259 | + }, | ||||
| 260 | + "repair": { | ||||
| 261 | + "lookups": 2, | ||||
| 262 | + "fetched_bytes": 1169, | ||||
| 263 | + "codes_mentioned": 3 | ||||
| 264 | + }, | ||||
| 265 | + "ledger": { | ||||
| 266 | + "facts_total": 66, | ||||
| 267 | + "facts_retained": 21, | ||||
| 268 | + "retention_rate": 0.3181818181818182, | ||||
| 269 | + "retention_by_kind": { | ||||
| 270 | + "person": 0.5, | ||||
| 271 | + "date": 0.0, | ||||
| 272 | + "amount": 0.35294117647058826, | ||||
| 273 | + "status": 0.5, | ||||
| 274 | + "place": 0.0, | ||||
| 275 | + "identifier": 0.3333333333333333, | ||||
| 276 | + "quantity": 0.3333333333333333 | ||||
| 277 | + }, | ||||
| 278 | + "unsupported_numbers": 1, | ||||
| 279 | + "unsupported_identifiers": 0, | ||||
| 280 | + "distorted_sentences": 1, | ||||
| 281 | + "message_bytes": 1435 | ||||
| 282 | + } | ||||
| 283 | + } | ||||
| 284 | + } | ||||
| 285 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03024_2000_A5_closed_qwen3b.json
+278 −0
@@ -0,0 +1,278 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}]}", | ||||
| 4 | + "2": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": []}", | ||||
| 5 | + "3": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": []}", | ||||
| 6 | + "4": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": []}", | ||||
| 7 | + "5": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": []}", | ||||
| 8 | + "6": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": []}", | ||||
| 9 | + "7": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": []}", | ||||
| 10 | + "8": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": []}" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6936.468709027395, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2212, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 784.3117910670117, | ||||
| 20 | + "sender_ttft_ms": 12.04549998510629, | ||||
| 21 | + "sender_decode_ms": 6137.790374923497 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 66, | ||||
| 29 | + "facts_retained": 6, | ||||
| 30 | + "retention_rate": 0.09090909090909091, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.16666666666666666, | ||||
| 33 | + "date": 0.0, | ||||
| 34 | + "amount": 0.17647058823529413, | ||||
| 35 | + "status": 0.0, | ||||
| 36 | + "place": 0.16666666666666666, | ||||
| 37 | + "identifier": 0.08333333333333333, | ||||
| 38 | + "quantity": 0.0 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 754 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 4546.723374980502, | ||||
| 48 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 542, | ||||
| 51 | + "sender_output_tokens": 363, | ||||
| 52 | + "sender_prefill_ms": 207.87337503861636, | ||||
| 53 | + "sender_ttft_ms": 12.090208008885384, | ||||
| 54 | + "sender_decode_ms": 4326.053625089116 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 0, | ||||
| 58 | + "fetched_bytes": 0 | ||||
| 59 | + }, | ||||
| 60 | + "ledger": { | ||||
| 61 | + "facts_total": 66, | ||||
| 62 | + "facts_retained": 8, | ||||
| 63 | + "retention_rate": 0.12121212121212122, | ||||
| 64 | + "retention_by_kind": { | ||||
| 65 | + "person": 0.16666666666666666, | ||||
| 66 | + "date": 0.0, | ||||
| 67 | + "amount": 0.17647058823529413, | ||||
| 68 | + "status": 0.16666666666666666, | ||||
| 69 | + "place": 0.16666666666666666, | ||||
| 70 | + "identifier": 0.08333333333333333, | ||||
| 71 | + "quantity": 0.0 | ||||
| 72 | + }, | ||||
| 73 | + "unsupported_numbers": 0, | ||||
| 74 | + "unsupported_identifiers": 0, | ||||
| 75 | + "distorted_sentences": 0, | ||||
| 76 | + "message_bytes": 770 | ||||
| 77 | + } | ||||
| 78 | + }, | ||||
| 79 | + "3": { | ||||
| 80 | + "hop_ms": 4562.344291014597, | ||||
| 81 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 82 | + "usage": { | ||||
| 83 | + "sender_input_tokens": 547, | ||||
| 84 | + "sender_output_tokens": 363, | ||||
| 85 | + "sender_prefill_ms": 209.79791693389416, | ||||
| 86 | + "sender_ttft_ms": 11.8742500199005, | ||||
| 87 | + "sender_decode_ms": 4339.969792054035 | ||||
| 88 | + }, | ||||
| 89 | + "repair": { | ||||
| 90 | + "lookups": 0, | ||||
| 91 | + "fetched_bytes": 0 | ||||
| 92 | + }, | ||||
| 93 | + "ledger": { | ||||
| 94 | + "facts_total": 66, | ||||
| 95 | + "facts_retained": 8, | ||||
| 96 | + "retention_rate": 0.12121212121212122, | ||||
| 97 | + "retention_by_kind": { | ||||
| 98 | + "person": 0.16666666666666666, | ||||
| 99 | + "date": 0.0, | ||||
| 100 | + "amount": 0.17647058823529413, | ||||
| 101 | + "status": 0.16666666666666666, | ||||
| 102 | + "place": 0.16666666666666666, | ||||
| 103 | + "identifier": 0.08333333333333333, | ||||
| 104 | + "quantity": 0.0 | ||||
| 105 | + }, | ||||
| 106 | + "unsupported_numbers": 0, | ||||
| 107 | + "unsupported_identifiers": 0, | ||||
| 108 | + "distorted_sentences": 0, | ||||
| 109 | + "message_bytes": 770 | ||||
| 110 | + } | ||||
| 111 | + }, | ||||
| 112 | + "4": { | ||||
| 113 | + "hop_ms": 4558.383625000715, | ||||
| 114 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 115 | + "usage": { | ||||
| 116 | + "sender_input_tokens": 547, | ||||
| 117 | + "sender_output_tokens": 363, | ||||
| 118 | + "sender_prefill_ms": 209.03074997477233, | ||||
| 119 | + "sender_ttft_ms": 12.323749950155616, | ||||
| 120 | + "sender_decode_ms": 4336.244708974846 | ||||
| 121 | + }, | ||||
| 122 | + "repair": { | ||||
| 123 | + "lookups": 0, | ||||
| 124 | + "fetched_bytes": 0 | ||||
| 125 | + }, | ||||
| 126 | + "ledger": { | ||||
| 127 | + "facts_total": 66, | ||||
| 128 | + "facts_retained": 8, | ||||
| 129 | + "retention_rate": 0.12121212121212122, | ||||
| 130 | + "retention_by_kind": { | ||||
| 131 | + "person": 0.16666666666666666, | ||||
| 132 | + "date": 0.0, | ||||
| 133 | + "amount": 0.17647058823529413, | ||||
| 134 | + "status": 0.16666666666666666, | ||||
| 135 | + "place": 0.16666666666666666, | ||||
| 136 | + "identifier": 0.08333333333333333, | ||||
| 137 | + "quantity": 0.0 | ||||
| 138 | + }, | ||||
| 139 | + "unsupported_numbers": 0, | ||||
| 140 | + "unsupported_identifiers": 0, | ||||
| 141 | + "distorted_sentences": 0, | ||||
| 142 | + "message_bytes": 770 | ||||
| 143 | + } | ||||
| 144 | + }, | ||||
| 145 | + "5": { | ||||
| 146 | + "hop_ms": 4559.562999987975, | ||||
| 147 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 148 | + "usage": { | ||||
| 149 | + "sender_input_tokens": 547, | ||||
| 150 | + "sender_output_tokens": 363, | ||||
| 151 | + "sender_prefill_ms": 209.61825002450496, | ||||
| 152 | + "sender_ttft_ms": 11.902916012331843, | ||||
| 153 | + "sender_decode_ms": 4337.379417032935 | ||||
| 154 | + }, | ||||
| 155 | + "repair": { | ||||
| 156 | + "lookups": 0, | ||||
| 157 | + "fetched_bytes": 0 | ||||
| 158 | + }, | ||||
| 159 | + "ledger": { | ||||
| 160 | + "facts_total": 66, | ||||
| 161 | + "facts_retained": 8, | ||||
| 162 | + "retention_rate": 0.12121212121212122, | ||||
| 163 | + "retention_by_kind": { | ||||
| 164 | + "person": 0.16666666666666666, | ||||
| 165 | + "date": 0.0, | ||||
| 166 | + "amount": 0.17647058823529413, | ||||
| 167 | + "status": 0.16666666666666666, | ||||
| 168 | + "place": 0.16666666666666666, | ||||
| 169 | + "identifier": 0.08333333333333333, | ||||
| 170 | + "quantity": 0.0 | ||||
| 171 | + }, | ||||
| 172 | + "unsupported_numbers": 0, | ||||
| 173 | + "unsupported_identifiers": 0, | ||||
| 174 | + "distorted_sentences": 0, | ||||
| 175 | + "message_bytes": 770 | ||||
| 176 | + } | ||||
| 177 | + }, | ||||
| 178 | + "6": { | ||||
| 179 | + "hop_ms": 4558.797375066206, | ||||
| 180 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 181 | + "usage": { | ||||
| 182 | + "sender_input_tokens": 547, | ||||
| 183 | + "sender_output_tokens": 363, | ||||
| 184 | + "sender_prefill_ms": 209.46312497835606, | ||||
| 185 | + "sender_ttft_ms": 11.91112503875047, | ||||
| 186 | + "sender_decode_ms": 4336.672958103009 | ||||
| 187 | + }, | ||||
| 188 | + "repair": { | ||||
| 189 | + "lookups": 0, | ||||
| 190 | + "fetched_bytes": 0 | ||||
| 191 | + }, | ||||
| 192 | + "ledger": { | ||||
| 193 | + "facts_total": 66, | ||||
| 194 | + "facts_retained": 8, | ||||
| 195 | + "retention_rate": 0.12121212121212122, | ||||
| 196 | + "retention_by_kind": { | ||||
| 197 | + "person": 0.16666666666666666, | ||||
| 198 | + "date": 0.0, | ||||
| 199 | + "amount": 0.17647058823529413, | ||||
| 200 | + "status": 0.16666666666666666, | ||||
| 201 | + "place": 0.16666666666666666, | ||||
| 202 | + "identifier": 0.08333333333333333, | ||||
| 203 | + "quantity": 0.0 | ||||
| 204 | + }, | ||||
| 205 | + "unsupported_numbers": 0, | ||||
| 206 | + "unsupported_identifiers": 0, | ||||
| 207 | + "distorted_sentences": 0, | ||||
| 208 | + "message_bytes": 770 | ||||
| 209 | + } | ||||
| 210 | + }, | ||||
| 211 | + "7": { | ||||
| 212 | + "hop_ms": 4563.401291961782, | ||||
| 213 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 214 | + "usage": { | ||||
| 215 | + "sender_input_tokens": 547, | ||||
| 216 | + "sender_output_tokens": 363, | ||||
| 217 | + "sender_prefill_ms": 209.000707953237, | ||||
| 218 | + "sender_ttft_ms": 12.010416947305202, | ||||
| 219 | + "sender_decode_ms": 4341.631207964383 | ||||
| 220 | + }, | ||||
| 221 | + "repair": { | ||||
| 222 | + "lookups": 0, | ||||
| 223 | + "fetched_bytes": 0 | ||||
| 224 | + }, | ||||
| 225 | + "ledger": { | ||||
| 226 | + "facts_total": 66, | ||||
| 227 | + "facts_retained": 8, | ||||
| 228 | + "retention_rate": 0.12121212121212122, | ||||
| 229 | + "retention_by_kind": { | ||||
| 230 | + "person": 0.16666666666666666, | ||||
| 231 | + "date": 0.0, | ||||
| 232 | + "amount": 0.17647058823529413, | ||||
| 233 | + "status": 0.16666666666666666, | ||||
| 234 | + "place": 0.16666666666666666, | ||||
| 235 | + "identifier": 0.08333333333333333, | ||||
| 236 | + "quantity": 0.0 | ||||
| 237 | + }, | ||||
| 238 | + "unsupported_numbers": 0, | ||||
| 239 | + "unsupported_identifiers": 0, | ||||
| 240 | + "distorted_sentences": 0, | ||||
| 241 | + "message_bytes": 770 | ||||
| 242 | + } | ||||
| 243 | + }, | ||||
| 244 | + "8": { | ||||
| 245 | + "hop_ms": 4558.95049998071, | ||||
| 246 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 247 | + "usage": { | ||||
| 248 | + "sender_input_tokens": 547, | ||||
| 249 | + "sender_output_tokens": 363, | ||||
| 250 | + "sender_prefill_ms": 209.89970804657787, | ||||
| 251 | + "sender_ttft_ms": 11.85295800678432, | ||||
| 252 | + "sender_decode_ms": 4336.4212500164285 | ||||
| 253 | + }, | ||||
| 254 | + "repair": { | ||||
| 255 | + "lookups": 0, | ||||
| 256 | + "fetched_bytes": 0 | ||||
| 257 | + }, | ||||
| 258 | + "ledger": { | ||||
| 259 | + "facts_total": 66, | ||||
| 260 | + "facts_retained": 8, | ||||
| 261 | + "retention_rate": 0.12121212121212122, | ||||
| 262 | + "retention_by_kind": { | ||||
| 263 | + "person": 0.16666666666666666, | ||||
| 264 | + "date": 0.0, | ||||
| 265 | + "amount": 0.17647058823529413, | ||||
| 266 | + "status": 0.16666666666666666, | ||||
| 267 | + "place": 0.16666666666666666, | ||||
| 268 | + "identifier": 0.08333333333333333, | ||||
| 269 | + "quantity": 0.0 | ||||
| 270 | + }, | ||||
| 271 | + "unsupported_numbers": 0, | ||||
| 272 | + "unsupported_identifiers": 0, | ||||
| 273 | + "distorted_sentences": 0, | ||||
| 274 | + "message_bytes": 770 | ||||
| 275 | + } | ||||
| 276 | + } | ||||
| 277 | + } | ||||
| 278 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03024_2000_A5_closed_qwen3b_llama3b.json
+278 −0
@@ -0,0 +1,278 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}]}", | ||||
| 4 | + "2": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"quote\": \"proposed by Bohdan Lindqvist\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"quote\": \"8,066,734 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"quote\": \"8,946,145 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"quote\": \"9,134,435 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"quote\": \"15 February 2031\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"quote\": \"Lot 568-G in Mont-Laurier\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"quote\": \"BU-55G-3254\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"quote\": \"cancelled\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 5 | + "3": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"quote\": \"proposed by Bohdan Lindqvist\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"quote\": \"8,066,734 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"quote\": \"8,946,145 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"quote\": \"9,134,435 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"quote\": \"15 February 2031\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"quote\": \"Lot 568-G in Mont-Laurier\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"quote\": \"BU-55G-3254\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"quote\": \"cancelled\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 6 | + "4": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"quote\": \"proposed by Bohdan Lindqvist\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"quote\": \"8,066,734 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"quote\": \"8,946,145 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"quote\": \"9,134,435 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"quote\": \"15 February 2031\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"quote\": \"Lot 568-G in Mont-Laurier\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"quote\": \"BU-55G-3254\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"quote\": \"cancelled\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 7 | + "5": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"quote\": \"proposed by Bohdan Lindqvist\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"quote\": \"8,066,734 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"quote\": \"8,946,145 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"quote\": \"9,134,435 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"quote\": \"15 February 2031\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"quote\": \"Lot 568-G in Mont-Laurier\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"quote\": \"BU-55G-3254\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"quote\": \"cancelled\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 8 | + "6": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"quote\": \"proposed by Bohdan Lindqvist\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"quote\": \"8,066,734 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"quote\": \"8,946,145 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"quote\": \"9,134,435 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"quote\": \"15 February 2031\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"quote\": \"Lot 568-G in Mont-Laurier\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"quote\": \"BU-55G-3254\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"quote\": \"cancelled\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 9 | + "7": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"quote\": \"proposed by Bohdan Lindqvist\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"quote\": \"8,066,734 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"quote\": \"8,946,145 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"quote\": \"9,134,435 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"quote\": \"15 February 2031\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"quote\": \"Lot 568-G in Mont-Laurier\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"quote\": \"BU-55G-3254\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"quote\": \"cancelled\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 10 | + "8": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"quote\": \"proposed by Bohdan Lindqvist\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"quote\": \"8,066,734 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"quote\": \"8,946,145 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"quote\": \"9,134,435 CAD\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"quote\": \"15 February 2031\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"quote\": \"Lot 568-G in Mont-Laurier\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"quote\": \"BU-55G-3254\"}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"quote\": \"cancelled\"}], \"notes\": \"\", \"unknowns\": []}" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6942.490917048417, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2212, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 788.4670000057667, | ||||
| 20 | + "sender_ttft_ms": 12.029499979689717, | ||||
| 21 | + "sender_decode_ms": 6139.711625059135 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 66, | ||||
| 29 | + "facts_retained": 6, | ||||
| 30 | + "retention_rate": 0.09090909090909091, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.16666666666666666, | ||||
| 33 | + "date": 0.0, | ||||
| 34 | + "amount": 0.17647058823529413, | ||||
| 35 | + "status": 0.0, | ||||
| 36 | + "place": 0.16666666666666666, | ||||
| 37 | + "identifier": 0.08333333333333333, | ||||
| 38 | + "quantity": 0.0 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 754 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 3957.965624984354, | ||||
| 48 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 502, | ||||
| 51 | + "sender_output_tokens": 323, | ||||
| 52 | + "sender_prefill_ms": 213.61295809037983, | ||||
| 53 | + "sender_ttft_ms": 12.21745798829943, | ||||
| 54 | + "sender_decode_ms": 3731.3317499356344 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 0, | ||||
| 58 | + "fetched_bytes": 0 | ||||
| 59 | + }, | ||||
| 60 | + "ledger": { | ||||
| 61 | + "facts_total": 66, | ||||
| 62 | + "facts_retained": 8, | ||||
| 63 | + "retention_rate": 0.12121212121212122, | ||||
| 64 | + "retention_by_kind": { | ||||
| 65 | + "person": 0.16666666666666666, | ||||
| 66 | + "date": 0.0, | ||||
| 67 | + "amount": 0.17647058823529413, | ||||
| 68 | + "status": 0.16666666666666666, | ||||
| 69 | + "place": 0.16666666666666666, | ||||
| 70 | + "identifier": 0.08333333333333333, | ||||
| 71 | + "quantity": 0.0 | ||||
| 72 | + }, | ||||
| 73 | + "unsupported_numbers": 0, | ||||
| 74 | + "unsupported_identifiers": 0, | ||||
| 75 | + "distorted_sentences": 0, | ||||
| 76 | + "message_bytes": 919 | ||||
| 77 | + } | ||||
| 78 | + }, | ||||
| 79 | + "3": { | ||||
| 80 | + "hop_ms": 4647.70749991294, | ||||
| 81 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 82 | + "usage": { | ||||
| 83 | + "sender_input_tokens": 555, | ||||
| 84 | + "sender_output_tokens": 371, | ||||
| 85 | + "sender_prefill_ms": 214.9672080995515, | ||||
| 86 | + "sender_ttft_ms": 12.076040962710977, | ||||
| 87 | + "sender_decode_ms": 4419.861208065413 | ||||
| 88 | + }, | ||||
| 89 | + "repair": { | ||||
| 90 | + "lookups": 0, | ||||
| 91 | + "fetched_bytes": 0 | ||||
| 92 | + }, | ||||
| 93 | + "ledger": { | ||||
| 94 | + "facts_total": 66, | ||||
| 95 | + "facts_retained": 8, | ||||
| 96 | + "retention_rate": 0.12121212121212122, | ||||
| 97 | + "retention_by_kind": { | ||||
| 98 | + "person": 0.16666666666666666, | ||||
| 99 | + "date": 0.0, | ||||
| 100 | + "amount": 0.17647058823529413, | ||||
| 101 | + "status": 0.16666666666666666, | ||||
| 102 | + "place": 0.16666666666666666, | ||||
| 103 | + "identifier": 0.08333333333333333, | ||||
| 104 | + "quantity": 0.0 | ||||
| 105 | + }, | ||||
| 106 | + "unsupported_numbers": 0, | ||||
| 107 | + "unsupported_identifiers": 0, | ||||
| 108 | + "distorted_sentences": 0, | ||||
| 109 | + "message_bytes": 919 | ||||
| 110 | + } | ||||
| 111 | + }, | ||||
| 112 | + "4": { | ||||
| 113 | + "hop_ms": 3966.145582962781, | ||||
| 114 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 115 | + "usage": { | ||||
| 116 | + "sender_input_tokens": 527, | ||||
| 117 | + "sender_output_tokens": 323, | ||||
| 118 | + "sender_prefill_ms": 215.67466703709215, | ||||
| 119 | + "sender_ttft_ms": 11.657292023301125, | ||||
| 120 | + "sender_decode_ms": 3737.996374955401 | ||||
| 121 | + }, | ||||
| 122 | + "repair": { | ||||
| 123 | + "lookups": 0, | ||||
| 124 | + "fetched_bytes": 0 | ||||
| 125 | + }, | ||||
| 126 | + "ledger": { | ||||
| 127 | + "facts_total": 66, | ||||
| 128 | + "facts_retained": 8, | ||||
| 129 | + "retention_rate": 0.12121212121212122, | ||||
| 130 | + "retention_by_kind": { | ||||
| 131 | + "person": 0.16666666666666666, | ||||
| 132 | + "date": 0.0, | ||||
| 133 | + "amount": 0.17647058823529413, | ||||
| 134 | + "status": 0.16666666666666666, | ||||
| 135 | + "place": 0.16666666666666666, | ||||
| 136 | + "identifier": 0.08333333333333333, | ||||
| 137 | + "quantity": 0.0 | ||||
| 138 | + }, | ||||
| 139 | + "unsupported_numbers": 0, | ||||
| 140 | + "unsupported_identifiers": 0, | ||||
| 141 | + "distorted_sentences": 0, | ||||
| 142 | + "message_bytes": 919 | ||||
| 143 | + } | ||||
| 144 | + }, | ||||
| 145 | + "5": { | ||||
| 146 | + "hop_ms": 4663.1102920509875, | ||||
| 147 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 148 | + "usage": { | ||||
| 149 | + "sender_input_tokens": 555, | ||||
| 150 | + "sender_output_tokens": 371, | ||||
| 151 | + "sender_prefill_ms": 214.51354201417416, | ||||
| 152 | + "sender_ttft_ms": 12.354000005871058, | ||||
| 153 | + "sender_decode_ms": 4435.459375032224 | ||||
| 154 | + }, | ||||
| 155 | + "repair": { | ||||
| 156 | + "lookups": 0, | ||||
| 157 | + "fetched_bytes": 0 | ||||
| 158 | + }, | ||||
| 159 | + "ledger": { | ||||
| 160 | + "facts_total": 66, | ||||
| 161 | + "facts_retained": 8, | ||||
| 162 | + "retention_rate": 0.12121212121212122, | ||||
| 163 | + "retention_by_kind": { | ||||
| 164 | + "person": 0.16666666666666666, | ||||
| 165 | + "date": 0.0, | ||||
| 166 | + "amount": 0.17647058823529413, | ||||
| 167 | + "status": 0.16666666666666666, | ||||
| 168 | + "place": 0.16666666666666666, | ||||
| 169 | + "identifier": 0.08333333333333333, | ||||
| 170 | + "quantity": 0.0 | ||||
| 171 | + }, | ||||
| 172 | + "unsupported_numbers": 0, | ||||
| 173 | + "unsupported_identifiers": 0, | ||||
| 174 | + "distorted_sentences": 0, | ||||
| 175 | + "message_bytes": 919 | ||||
| 176 | + } | ||||
| 177 | + }, | ||||
| 178 | + "6": { | ||||
| 179 | + "hop_ms": 3976.8799169687554, | ||||
| 180 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 181 | + "usage": { | ||||
| 182 | + "sender_input_tokens": 527, | ||||
| 183 | + "sender_output_tokens": 323, | ||||
| 184 | + "sender_prefill_ms": 220.19841708242893, | ||||
| 185 | + "sender_ttft_ms": 11.653374996967614, | ||||
| 186 | + "sender_decode_ms": 3744.164749979973 | ||||
| 187 | + }, | ||||
| 188 | + "repair": { | ||||
| 189 | + "lookups": 0, | ||||
| 190 | + "fetched_bytes": 0 | ||||
| 191 | + }, | ||||
| 192 | + "ledger": { | ||||
| 193 | + "facts_total": 66, | ||||
| 194 | + "facts_retained": 8, | ||||
| 195 | + "retention_rate": 0.12121212121212122, | ||||
| 196 | + "retention_by_kind": { | ||||
| 197 | + "person": 0.16666666666666666, | ||||
| 198 | + "date": 0.0, | ||||
| 199 | + "amount": 0.17647058823529413, | ||||
| 200 | + "status": 0.16666666666666666, | ||||
| 201 | + "place": 0.16666666666666666, | ||||
| 202 | + "identifier": 0.08333333333333333, | ||||
| 203 | + "quantity": 0.0 | ||||
| 204 | + }, | ||||
| 205 | + "unsupported_numbers": 0, | ||||
| 206 | + "unsupported_identifiers": 0, | ||||
| 207 | + "distorted_sentences": 0, | ||||
| 208 | + "message_bytes": 919 | ||||
| 209 | + } | ||||
| 210 | + }, | ||||
| 211 | + "7": { | ||||
| 212 | + "hop_ms": 4664.292625035159, | ||||
| 213 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 214 | + "usage": { | ||||
| 215 | + "sender_input_tokens": 555, | ||||
| 216 | + "sender_output_tokens": 371, | ||||
| 217 | + "sender_prefill_ms": 215.09754203725606, | ||||
| 218 | + "sender_ttft_ms": 12.074208003468812, | ||||
| 219 | + "sender_decode_ms": 4436.304041999392 | ||||
| 220 | + }, | ||||
| 221 | + "repair": { | ||||
| 222 | + "lookups": 0, | ||||
| 223 | + "fetched_bytes": 0 | ||||
| 224 | + }, | ||||
| 225 | + "ledger": { | ||||
| 226 | + "facts_total": 66, | ||||
| 227 | + "facts_retained": 8, | ||||
| 228 | + "retention_rate": 0.12121212121212122, | ||||
| 229 | + "retention_by_kind": { | ||||
| 230 | + "person": 0.16666666666666666, | ||||
| 231 | + "date": 0.0, | ||||
| 232 | + "amount": 0.17647058823529413, | ||||
| 233 | + "status": 0.16666666666666666, | ||||
| 234 | + "place": 0.16666666666666666, | ||||
| 235 | + "identifier": 0.08333333333333333, | ||||
| 236 | + "quantity": 0.0 | ||||
| 237 | + }, | ||||
| 238 | + "unsupported_numbers": 0, | ||||
| 239 | + "unsupported_identifiers": 0, | ||||
| 240 | + "distorted_sentences": 0, | ||||
| 241 | + "message_bytes": 919 | ||||
| 242 | + } | ||||
| 243 | + }, | ||||
| 244 | + "8": { | ||||
| 245 | + "hop_ms": 3971.1806669365615, | ||||
| 246 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 247 | + "usage": { | ||||
| 248 | + "sender_input_tokens": 527, | ||||
| 249 | + "sender_output_tokens": 323, | ||||
| 250 | + "sender_prefill_ms": 215.5960410600528, | ||||
| 251 | + "sender_ttft_ms": 11.651166947558522, | ||||
| 252 | + "sender_decode_ms": 3743.155249976553 | ||||
| 253 | + }, | ||||
| 254 | + "repair": { | ||||
| 255 | + "lookups": 0, | ||||
| 256 | + "fetched_bytes": 0 | ||||
| 257 | + }, | ||||
| 258 | + "ledger": { | ||||
| 259 | + "facts_total": 66, | ||||
| 260 | + "facts_retained": 8, | ||||
| 261 | + "retention_rate": 0.12121212121212122, | ||||
| 262 | + "retention_by_kind": { | ||||
| 263 | + "person": 0.16666666666666666, | ||||
| 264 | + "date": 0.0, | ||||
| 265 | + "amount": 0.17647058823529413, | ||||
| 266 | + "status": 0.16666666666666666, | ||||
| 267 | + "place": 0.16666666666666666, | ||||
| 268 | + "identifier": 0.08333333333333333, | ||||
| 269 | + "quantity": 0.0 | ||||
| 270 | + }, | ||||
| 271 | + "unsupported_numbers": 0, | ||||
| 272 | + "unsupported_identifiers": 0, | ||||
| 273 | + "distorted_sentences": 0, | ||||
| 274 | + "message_bytes": 919 | ||||
| 275 | + } | ||||
| 276 | + } | ||||
| 277 | + } | ||||
| 278 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03024_2000_A5_repairable_qwen3b.json
+285 −0
@@ -0,0 +1,285 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}]}", | ||||
| 4 | + "2": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": [], \"notes\": \"\"}", | ||||
| 5 | + "3": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": [], \"notes\": \"\"}", | ||||
| 6 | + "4": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": [], \"notes\": \"\"}", | ||||
| 7 | + "5": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": [], \"notes\": \"\"}", | ||||
| 8 | + "6": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": [], \"notes\": \"\"}", | ||||
| 9 | + "7": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": [], \"notes\": \"\"}", | ||||
| 10 | + "8": "{\"facts\": [{\"entity\": \"Quilun-16\", \"attribute\": \"proposed by\", \"value\": \"Bohdan Lindqvist\", \"span\": [238, 318]}, {\"entity\": \"Quilun-16\", \"attribute\": \"initial budget\", \"value\": \"8,066,734 CAD\", \"span\": [320, 432]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"8,946,145 CAD\", \"span\": [506, 578]}, {\"entity\": \"Quilun-16\", \"attribute\": \"final budget\", \"value\": \"9,134,435 CAD\", \"span\": [433, 505]}, {\"entity\": \"Quilun-16\", \"attribute\": \"approval date\", \"value\": \"15 February 2031\", \"span\": [579, 648]}, {\"entity\": \"Quilun-16\", \"attribute\": \"site\", \"value\": \"Lot 568-G in Mont-Laurier\", \"span\": [649, 700]}, {\"entity\": \"Quilun-16\", \"attribute\": \"supplier identifier\", \"value\": \"BU-55G-3254\", \"span\": [701, 754]}, {\"entity\": \"Quilun-16\", \"attribute\": \"status\", \"value\": \"cancelled\", \"span\": [755, 801]}], \"unknowns\": [], \"notes\": \"\"}" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6938.470332999714, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2212, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 783.4977910388261, | ||||
| 20 | + "sender_ttft_ms": 12.114874902181327, | ||||
| 21 | + "sender_decode_ms": 6140.633500064723 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 66, | ||||
| 29 | + "facts_retained": 6, | ||||
| 30 | + "retention_rate": 0.09090909090909091, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.16666666666666666, | ||||
| 33 | + "date": 0.0, | ||||
| 34 | + "amount": 0.17647058823529413, | ||||
| 35 | + "status": 0.0, | ||||
| 36 | + "place": 0.16666666666666666, | ||||
| 37 | + "identifier": 0.08333333333333333, | ||||
| 38 | + "quantity": 0.0 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 754 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 4700.964290997945, | ||||
| 48 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 793, | ||||
| 51 | + "sender_output_tokens": 367, | ||||
| 52 | + "sender_prefill_ms": 291.7911249678582, | ||||
| 53 | + "sender_ttft_ms": 12.245708028785884, | ||||
| 54 | + "sender_decode_ms": 4395.956667023711 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 1, | ||||
| 58 | + "fetched_bytes": 582, | ||||
| 59 | + "codes_mentioned": 1 | ||||
| 60 | + }, | ||||
| 61 | + "ledger": { | ||||
| 62 | + "facts_total": 66, | ||||
| 63 | + "facts_retained": 8, | ||||
| 64 | + "retention_rate": 0.12121212121212122, | ||||
| 65 | + "retention_by_kind": { | ||||
| 66 | + "person": 0.16666666666666666, | ||||
| 67 | + "date": 0.0, | ||||
| 68 | + "amount": 0.17647058823529413, | ||||
| 69 | + "status": 0.16666666666666666, | ||||
| 70 | + "place": 0.16666666666666666, | ||||
| 71 | + "identifier": 0.08333333333333333, | ||||
| 72 | + "quantity": 0.0 | ||||
| 73 | + }, | ||||
| 74 | + "unsupported_numbers": 0, | ||||
| 75 | + "unsupported_identifiers": 0, | ||||
| 76 | + "distorted_sentences": 0, | ||||
| 77 | + "message_bytes": 783 | ||||
| 78 | + } | ||||
| 79 | + }, | ||||
| 80 | + "3": { | ||||
| 81 | + "hop_ms": 4701.423165970482, | ||||
| 82 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 83 | + "usage": { | ||||
| 84 | + "sender_input_tokens": 802, | ||||
| 85 | + "sender_output_tokens": 367, | ||||
| 86 | + "sender_prefill_ms": 293.08737500105053, | ||||
| 87 | + "sender_ttft_ms": 11.983665986917913, | ||||
| 88 | + "sender_decode_ms": 4395.327874924988 | ||||
| 89 | + }, | ||||
| 90 | + "repair": { | ||||
| 91 | + "lookups": 1, | ||||
| 92 | + "fetched_bytes": 582, | ||||
| 93 | + "codes_mentioned": 1 | ||||
| 94 | + }, | ||||
| 95 | + "ledger": { | ||||
| 96 | + "facts_total": 66, | ||||
| 97 | + "facts_retained": 8, | ||||
| 98 | + "retention_rate": 0.12121212121212122, | ||||
| 99 | + "retention_by_kind": { | ||||
| 100 | + "person": 0.16666666666666666, | ||||
| 101 | + "date": 0.0, | ||||
| 102 | + "amount": 0.17647058823529413, | ||||
| 103 | + "status": 0.16666666666666666, | ||||
| 104 | + "place": 0.16666666666666666, | ||||
| 105 | + "identifier": 0.08333333333333333, | ||||
| 106 | + "quantity": 0.0 | ||||
| 107 | + }, | ||||
| 108 | + "unsupported_numbers": 0, | ||||
| 109 | + "unsupported_identifiers": 0, | ||||
| 110 | + "distorted_sentences": 0, | ||||
| 111 | + "message_bytes": 783 | ||||
| 112 | + } | ||||
| 113 | + }, | ||||
| 114 | + "4": { | ||||
| 115 | + "hop_ms": 4716.0387500189245, | ||||
| 116 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 117 | + "usage": { | ||||
| 118 | + "sender_input_tokens": 802, | ||||
| 119 | + "sender_output_tokens": 367, | ||||
| 120 | + "sender_prefill_ms": 292.8457499947399, | ||||
| 121 | + "sender_ttft_ms": 12.152499984949827, | ||||
| 122 | + "sender_decode_ms": 4409.95295799803 | ||||
| 123 | + }, | ||||
| 124 | + "repair": { | ||||
| 125 | + "lookups": 1, | ||||
| 126 | + "fetched_bytes": 582, | ||||
| 127 | + "codes_mentioned": 1 | ||||
| 128 | + }, | ||||
| 129 | + "ledger": { | ||||
| 130 | + "facts_total": 66, | ||||
| 131 | + "facts_retained": 8, | ||||
| 132 | + "retention_rate": 0.12121212121212122, | ||||
| 133 | + "retention_by_kind": { | ||||
| 134 | + "person": 0.16666666666666666, | ||||
| 135 | + "date": 0.0, | ||||
| 136 | + "amount": 0.17647058823529413, | ||||
| 137 | + "status": 0.16666666666666666, | ||||
| 138 | + "place": 0.16666666666666666, | ||||
| 139 | + "identifier": 0.08333333333333333, | ||||
| 140 | + "quantity": 0.0 | ||||
| 141 | + }, | ||||
| 142 | + "unsupported_numbers": 0, | ||||
| 143 | + "unsupported_identifiers": 0, | ||||
| 144 | + "distorted_sentences": 0, | ||||
| 145 | + "message_bytes": 783 | ||||
| 146 | + } | ||||
| 147 | + }, | ||||
| 148 | + "5": { | ||||
| 149 | + "hop_ms": 4711.475750082172, | ||||
| 150 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 151 | + "usage": { | ||||
| 152 | + "sender_input_tokens": 802, | ||||
| 153 | + "sender_output_tokens": 367, | ||||
| 154 | + "sender_prefill_ms": 292.4278340069577, | ||||
| 155 | + "sender_ttft_ms": 12.00774998869747, | ||||
| 156 | + "sender_decode_ms": 4406.034791958518 | ||||
| 157 | + }, | ||||
| 158 | + "repair": { | ||||
| 159 | + "lookups": 1, | ||||
| 160 | + "fetched_bytes": 582, | ||||
| 161 | + "codes_mentioned": 1 | ||||
| 162 | + }, | ||||
| 163 | + "ledger": { | ||||
| 164 | + "facts_total": 66, | ||||
| 165 | + "facts_retained": 8, | ||||
| 166 | + "retention_rate": 0.12121212121212122, | ||||
| 167 | + "retention_by_kind": { | ||||
| 168 | + "person": 0.16666666666666666, | ||||
| 169 | + "date": 0.0, | ||||
| 170 | + "amount": 0.17647058823529413, | ||||
| 171 | + "status": 0.16666666666666666, | ||||
| 172 | + "place": 0.16666666666666666, | ||||
| 173 | + "identifier": 0.08333333333333333, | ||||
| 174 | + "quantity": 0.0 | ||||
| 175 | + }, | ||||
| 176 | + "unsupported_numbers": 0, | ||||
| 177 | + "unsupported_identifiers": 0, | ||||
| 178 | + "distorted_sentences": 0, | ||||
| 179 | + "message_bytes": 783 | ||||
| 180 | + } | ||||
| 181 | + }, | ||||
| 182 | + "6": { | ||||
| 183 | + "hop_ms": 4709.1882498934865, | ||||
| 184 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 185 | + "usage": { | ||||
| 186 | + "sender_input_tokens": 802, | ||||
| 187 | + "sender_output_tokens": 367, | ||||
| 188 | + "sender_prefill_ms": 292.7607500459999, | ||||
| 189 | + "sender_ttft_ms": 11.922291945666075, | ||||
| 190 | + "sender_decode_ms": 4403.45183305908 | ||||
| 191 | + }, | ||||
| 192 | + "repair": { | ||||
| 193 | + "lookups": 1, | ||||
| 194 | + "fetched_bytes": 582, | ||||
| 195 | + "codes_mentioned": 1 | ||||
| 196 | + }, | ||||
| 197 | + "ledger": { | ||||
| 198 | + "facts_total": 66, | ||||
| 199 | + "facts_retained": 8, | ||||
| 200 | + "retention_rate": 0.12121212121212122, | ||||
| 201 | + "retention_by_kind": { | ||||
| 202 | + "person": 0.16666666666666666, | ||||
| 203 | + "date": 0.0, | ||||
| 204 | + "amount": 0.17647058823529413, | ||||
| 205 | + "status": 0.16666666666666666, | ||||
| 206 | + "place": 0.16666666666666666, | ||||
| 207 | + "identifier": 0.08333333333333333, | ||||
| 208 | + "quantity": 0.0 | ||||
| 209 | + }, | ||||
| 210 | + "unsupported_numbers": 0, | ||||
| 211 | + "unsupported_identifiers": 0, | ||||
| 212 | + "distorted_sentences": 0, | ||||
| 213 | + "message_bytes": 783 | ||||
| 214 | + } | ||||
| 215 | + }, | ||||
| 216 | + "7": { | ||||
| 217 | + "hop_ms": 4716.373875038698, | ||||
| 218 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 219 | + "usage": { | ||||
| 220 | + "sender_input_tokens": 802, | ||||
| 221 | + "sender_output_tokens": 367, | ||||
| 222 | + "sender_prefill_ms": 292.81216708477587, | ||||
| 223 | + "sender_ttft_ms": 12.199625023640692, | ||||
| 224 | + "sender_decode_ms": 4410.257542040199 | ||||
| 225 | + }, | ||||
| 226 | + "repair": { | ||||
| 227 | + "lookups": 1, | ||||
| 228 | + "fetched_bytes": 582, | ||||
| 229 | + "codes_mentioned": 1 | ||||
| 230 | + }, | ||||
| 231 | + "ledger": { | ||||
| 232 | + "facts_total": 66, | ||||
| 233 | + "facts_retained": 8, | ||||
| 234 | + "retention_rate": 0.12121212121212122, | ||||
| 235 | + "retention_by_kind": { | ||||
| 236 | + "person": 0.16666666666666666, | ||||
| 237 | + "date": 0.0, | ||||
| 238 | + "amount": 0.17647058823529413, | ||||
| 239 | + "status": 0.16666666666666666, | ||||
| 240 | + "place": 0.16666666666666666, | ||||
| 241 | + "identifier": 0.08333333333333333, | ||||
| 242 | + "quantity": 0.0 | ||||
| 243 | + }, | ||||
| 244 | + "unsupported_numbers": 0, | ||||
| 245 | + "unsupported_identifiers": 0, | ||||
| 246 | + "distorted_sentences": 0, | ||||
| 247 | + "message_bytes": 783 | ||||
| 248 | + } | ||||
| 249 | + }, | ||||
| 250 | + "8": { | ||||
| 251 | + "hop_ms": 4709.4037079950795, | ||||
| 252 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 253 | + "usage": { | ||||
| 254 | + "sender_input_tokens": 802, | ||||
| 255 | + "sender_output_tokens": 367, | ||||
| 256 | + "sender_prefill_ms": 292.3464170889929, | ||||
| 257 | + "sender_ttft_ms": 12.12249998934567, | ||||
| 258 | + "sender_decode_ms": 4403.891457943246 | ||||
| 259 | + }, | ||||
| 260 | + "repair": { | ||||
| 261 | + "lookups": 1, | ||||
| 262 | + "fetched_bytes": 582, | ||||
| 263 | + "codes_mentioned": 1 | ||||
| 264 | + }, | ||||
| 265 | + "ledger": { | ||||
| 266 | + "facts_total": 66, | ||||
| 267 | + "facts_retained": 8, | ||||
| 268 | + "retention_rate": 0.12121212121212122, | ||||
| 269 | + "retention_by_kind": { | ||||
| 270 | + "person": 0.16666666666666666, | ||||
| 271 | + "date": 0.0, | ||||
| 272 | + "amount": 0.17647058823529413, | ||||
| 273 | + "status": 0.16666666666666666, | ||||
| 274 | + "place": 0.16666666666666666, | ||||
| 275 | + "identifier": 0.08333333333333333, | ||||
| 276 | + "quantity": 0.0 | ||||
| 277 | + }, | ||||
| 278 | + "unsupported_numbers": 0, | ||||
| 279 | + "unsupported_identifiers": 0, | ||||
| 280 | + "distorted_sentences": 0, | ||||
| 281 | + "message_bytes": 783 | ||||
| 282 | + } | ||||
| 283 | + } | ||||
| 284 | + } | ||||
| 285 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03027_2000_A4_closed_qwen3b.json
+278 −0
@@ -0,0 +1,278 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 4 | + "2": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 5 | + "3": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 6 | + "4": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 7 | + "5": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 8 | + "6": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 9 | + "7": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 10 | + "8": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6896.277834079228, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2071, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 731.609083013609, | ||||
| 20 | + "sender_ttft_ms": 12.220749980770051, | ||||
| 21 | + "sender_decode_ms": 6150.061208987609 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 63, | ||||
| 29 | + "facts_retained": 27, | ||||
| 30 | + "retention_rate": 0.42857142857142855, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.5, | ||||
| 33 | + "date": 0.125, | ||||
| 34 | + "amount": 0.6153846153846154, | ||||
| 35 | + "status": 0.75, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.3333333333333333, | ||||
| 38 | + "quantity": 0.3333333333333333 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 1087 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 6372.689875075594, | ||||
| 48 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 629, | ||||
| 51 | + "sender_output_tokens": 512, | ||||
| 52 | + "sender_prefill_ms": 230.27745902072638, | ||||
| 53 | + "sender_ttft_ms": 12.046166928485036, | ||||
| 54 | + "sender_decode_ms": 6129.636915982701 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 0, | ||||
| 58 | + "fetched_bytes": 0 | ||||
| 59 | + }, | ||||
| 60 | + "ledger": { | ||||
| 61 | + "facts_total": 63, | ||||
| 62 | + "facts_retained": 27, | ||||
| 63 | + "retention_rate": 0.42857142857142855, | ||||
| 64 | + "retention_by_kind": { | ||||
| 65 | + "person": 0.5, | ||||
| 66 | + "date": 0.125, | ||||
| 67 | + "amount": 0.6153846153846154, | ||||
| 68 | + "status": 0.75, | ||||
| 69 | + "place": 0.0, | ||||
| 70 | + "identifier": 0.3333333333333333, | ||||
| 71 | + "quantity": 0.3333333333333333 | ||||
| 72 | + }, | ||||
| 73 | + "unsupported_numbers": 0, | ||||
| 74 | + "unsupported_identifiers": 0, | ||||
| 75 | + "distorted_sentences": 0, | ||||
| 76 | + "message_bytes": 1087 | ||||
| 77 | + } | ||||
| 78 | + }, | ||||
| 79 | + "3": { | ||||
| 80 | + "hop_ms": 6377.503250027075, | ||||
| 81 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 82 | + "usage": { | ||||
| 83 | + "sender_input_tokens": 629, | ||||
| 84 | + "sender_output_tokens": 512, | ||||
| 85 | + "sender_prefill_ms": 229.47583394125104, | ||||
| 86 | + "sender_ttft_ms": 11.81108399759978, | ||||
| 87 | + "sender_decode_ms": 6135.5068749981 | ||||
| 88 | + }, | ||||
| 89 | + "repair": { | ||||
| 90 | + "lookups": 0, | ||||
| 91 | + "fetched_bytes": 0 | ||||
| 92 | + }, | ||||
| 93 | + "ledger": { | ||||
| 94 | + "facts_total": 63, | ||||
| 95 | + "facts_retained": 27, | ||||
| 96 | + "retention_rate": 0.42857142857142855, | ||||
| 97 | + "retention_by_kind": { | ||||
| 98 | + "person": 0.5, | ||||
| 99 | + "date": 0.125, | ||||
| 100 | + "amount": 0.6153846153846154, | ||||
| 101 | + "status": 0.75, | ||||
| 102 | + "place": 0.0, | ||||
| 103 | + "identifier": 0.3333333333333333, | ||||
| 104 | + "quantity": 0.3333333333333333 | ||||
| 105 | + }, | ||||
| 106 | + "unsupported_numbers": 0, | ||||
| 107 | + "unsupported_identifiers": 0, | ||||
| 108 | + "distorted_sentences": 0, | ||||
| 109 | + "message_bytes": 1087 | ||||
| 110 | + } | ||||
| 111 | + }, | ||||
| 112 | + "4": { | ||||
| 113 | + "hop_ms": 6359.274166985415, | ||||
| 114 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 115 | + "usage": { | ||||
| 116 | + "sender_input_tokens": 629, | ||||
| 117 | + "sender_output_tokens": 512, | ||||
| 118 | + "sender_prefill_ms": 229.95983297005296, | ||||
| 119 | + "sender_ttft_ms": 12.037583976052701, | ||||
| 120 | + "sender_decode_ms": 6116.4696250343695 | ||||
| 121 | + }, | ||||
| 122 | + "repair": { | ||||
| 123 | + "lookups": 0, | ||||
| 124 | + "fetched_bytes": 0 | ||||
| 125 | + }, | ||||
| 126 | + "ledger": { | ||||
| 127 | + "facts_total": 63, | ||||
| 128 | + "facts_retained": 27, | ||||
| 129 | + "retention_rate": 0.42857142857142855, | ||||
| 130 | + "retention_by_kind": { | ||||
| 131 | + "person": 0.5, | ||||
| 132 | + "date": 0.125, | ||||
| 133 | + "amount": 0.6153846153846154, | ||||
| 134 | + "status": 0.75, | ||||
| 135 | + "place": 0.0, | ||||
| 136 | + "identifier": 0.3333333333333333, | ||||
| 137 | + "quantity": 0.3333333333333333 | ||||
| 138 | + }, | ||||
| 139 | + "unsupported_numbers": 0, | ||||
| 140 | + "unsupported_identifiers": 0, | ||||
| 141 | + "distorted_sentences": 0, | ||||
| 142 | + "message_bytes": 1087 | ||||
| 143 | + } | ||||
| 144 | + }, | ||||
| 145 | + "5": { | ||||
| 146 | + "hop_ms": 6348.349208012223, | ||||
| 147 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 148 | + "usage": { | ||||
| 149 | + "sender_input_tokens": 629, | ||||
| 150 | + "sender_output_tokens": 512, | ||||
| 151 | + "sender_prefill_ms": 228.99104200769216, | ||||
| 152 | + "sender_ttft_ms": 12.30641605798155, | ||||
| 153 | + "sender_decode_ms": 6106.280207983218 | ||||
| 154 | + }, | ||||
| 155 | + "repair": { | ||||
| 156 | + "lookups": 0, | ||||
| 157 | + "fetched_bytes": 0 | ||||
| 158 | + }, | ||||
| 159 | + "ledger": { | ||||
| 160 | + "facts_total": 63, | ||||
| 161 | + "facts_retained": 27, | ||||
| 162 | + "retention_rate": 0.42857142857142855, | ||||
| 163 | + "retention_by_kind": { | ||||
| 164 | + "person": 0.5, | ||||
| 165 | + "date": 0.125, | ||||
| 166 | + "amount": 0.6153846153846154, | ||||
| 167 | + "status": 0.75, | ||||
| 168 | + "place": 0.0, | ||||
| 169 | + "identifier": 0.3333333333333333, | ||||
| 170 | + "quantity": 0.3333333333333333 | ||||
| 171 | + }, | ||||
| 172 | + "unsupported_numbers": 0, | ||||
| 173 | + "unsupported_identifiers": 0, | ||||
| 174 | + "distorted_sentences": 0, | ||||
| 175 | + "message_bytes": 1087 | ||||
| 176 | + } | ||||
| 177 | + }, | ||||
| 178 | + "6": { | ||||
| 179 | + "hop_ms": 6350.234291981906, | ||||
| 180 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 181 | + "usage": { | ||||
| 182 | + "sender_input_tokens": 629, | ||||
| 183 | + "sender_output_tokens": 512, | ||||
| 184 | + "sender_prefill_ms": 229.4836670625955, | ||||
| 185 | + "sender_ttft_ms": 11.96037488989532, | ||||
| 186 | + "sender_decode_ms": 6108.006666996516 | ||||
| 187 | + }, | ||||
| 188 | + "repair": { | ||||
| 189 | + "lookups": 0, | ||||
| 190 | + "fetched_bytes": 0 | ||||
| 191 | + }, | ||||
| 192 | + "ledger": { | ||||
| 193 | + "facts_total": 63, | ||||
| 194 | + "facts_retained": 27, | ||||
| 195 | + "retention_rate": 0.42857142857142855, | ||||
| 196 | + "retention_by_kind": { | ||||
| 197 | + "person": 0.5, | ||||
| 198 | + "date": 0.125, | ||||
| 199 | + "amount": 0.6153846153846154, | ||||
| 200 | + "status": 0.75, | ||||
| 201 | + "place": 0.0, | ||||
| 202 | + "identifier": 0.3333333333333333, | ||||
| 203 | + "quantity": 0.3333333333333333 | ||||
| 204 | + }, | ||||
| 205 | + "unsupported_numbers": 0, | ||||
| 206 | + "unsupported_identifiers": 0, | ||||
| 207 | + "distorted_sentences": 0, | ||||
| 208 | + "message_bytes": 1087 | ||||
| 209 | + } | ||||
| 210 | + }, | ||||
| 211 | + "7": { | ||||
| 212 | + "hop_ms": 6348.7960420316085, | ||||
| 213 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 214 | + "usage": { | ||||
| 215 | + "sender_input_tokens": 629, | ||||
| 216 | + "sender_output_tokens": 512, | ||||
| 217 | + "sender_prefill_ms": 229.78499997407198, | ||||
| 218 | + "sender_ttft_ms": 11.929832980968058, | ||||
| 219 | + "sender_decode_ms": 6106.293958961032 | ||||
| 220 | + }, | ||||
| 221 | + "repair": { | ||||
| 222 | + "lookups": 0, | ||||
| 223 | + "fetched_bytes": 0 | ||||
| 224 | + }, | ||||
| 225 | + "ledger": { | ||||
| 226 | + "facts_total": 63, | ||||
| 227 | + "facts_retained": 27, | ||||
| 228 | + "retention_rate": 0.42857142857142855, | ||||
| 229 | + "retention_by_kind": { | ||||
| 230 | + "person": 0.5, | ||||
| 231 | + "date": 0.125, | ||||
| 232 | + "amount": 0.6153846153846154, | ||||
| 233 | + "status": 0.75, | ||||
| 234 | + "place": 0.0, | ||||
| 235 | + "identifier": 0.3333333333333333, | ||||
| 236 | + "quantity": 0.3333333333333333 | ||||
| 237 | + }, | ||||
| 238 | + "unsupported_numbers": 0, | ||||
| 239 | + "unsupported_identifiers": 0, | ||||
| 240 | + "distorted_sentences": 0, | ||||
| 241 | + "message_bytes": 1087 | ||||
| 242 | + } | ||||
| 243 | + }, | ||||
| 244 | + "8": { | ||||
| 245 | + "hop_ms": 6352.555750054307, | ||||
| 246 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 247 | + "usage": { | ||||
| 248 | + "sender_input_tokens": 629, | ||||
| 249 | + "sender_output_tokens": 512, | ||||
| 250 | + "sender_prefill_ms": 229.55887496937066, | ||||
| 251 | + "sender_ttft_ms": 11.91633299458772, | ||||
| 252 | + "sender_decode_ms": 6110.2541659493 | ||||
| 253 | + }, | ||||
| 254 | + "repair": { | ||||
| 255 | + "lookups": 0, | ||||
| 256 | + "fetched_bytes": 0 | ||||
| 257 | + }, | ||||
| 258 | + "ledger": { | ||||
| 259 | + "facts_total": 63, | ||||
| 260 | + "facts_retained": 27, | ||||
| 261 | + "retention_rate": 0.42857142857142855, | ||||
| 262 | + "retention_by_kind": { | ||||
| 263 | + "person": 0.5, | ||||
| 264 | + "date": 0.125, | ||||
| 265 | + "amount": 0.6153846153846154, | ||||
| 266 | + "status": 0.75, | ||||
| 267 | + "place": 0.0, | ||||
| 268 | + "identifier": 0.3333333333333333, | ||||
| 269 | + "quantity": 0.3333333333333333 | ||||
| 270 | + }, | ||||
| 271 | + "unsupported_numbers": 0, | ||||
| 272 | + "unsupported_identifiers": 0, | ||||
| 273 | + "distorted_sentences": 0, | ||||
| 274 | + "message_bytes": 1087 | ||||
| 275 | + } | ||||
| 276 | + } | ||||
| 277 | + } | ||||
| 278 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03027_2000_A4_closed_qwen3b_llama3b.json
+278 −0
@@ -0,0 +1,278 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 4 | + "2": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review:** \n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 5 | + "3": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review:**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 6 | + "4": "**Capital Projects Register, Issue 680**\n\nThe following projects are under review: Sollith-7, Banurlun-13, and Lunlith-18.\n\n**Project Sollith-4:**\n\n- Proposed by Priyamvada Sørlie on 15 Aug 2030\n- Initial budget: 6,914,937 CAD\n- Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n- Approved on 14 Feb 2031\n- Site: Lot 596-B, Chibougamau\n- Supplier: WT-26M-9227\n- Launch postponed to 25 May 2031\n- Rated capacity: 14.59 MW\n- Calibration constant: 72.7163\n\n**Project Banurlun-12:**\n\n- Proposed by Nnamdi Varga on 21 Feb 2031\n- Initial budget: 1,787,610 CAD\n- Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n- Approved on 11 Jul 2031\n- Site: Lot 655-W, Gaspé\n- Supplier: ZZ-20U-3727\n- Cancelled\n- Rated capacity: 16.49 t\n- Calibration constant: 15.0054\n\n**Project Lunlith-13:**\n\n- Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n- Initial budget: 8,278,225 CAD\n- Revised budget: 8,244,865 CAD\n- Rejected on 17 Oct 2030\n- Site: Lot 247-S, Baie-Comeau\n- Supplier: DD-69N-1", | ||||
| 7 | + "5": "**Capital Projects Register, Issue 680**\n\n- Projects under review: Sollith-7, Banurlun-13, Lunlith-18\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 8 | + "6": "**Capital Projects Register, Issue 680**\n\nThe document lists projects under review: Sollith-7, Banurlun-13, and Lunlith-18. \n\nProject Sollith-4:\n- Proposed by Priyamvada Sørlie on 15 Aug 2030\n- Initial budget: 6,914,937 CAD\n- Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n- Approved on 14 Feb 2031\n- Site: Lot 596-B, Chibougamau\n- Supplier: WT-26M-9227\n- Launch postponed to 25 May 2031\n- Rated capacity: 14.59 MW\n- Calibration constant: 72.7163\n\nProject Banurlun-12:\n- Proposed by Nnamdi Varga on 21 Feb 2031\n- Initial budget: 1,787,610 CAD\n- Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n- Approved on 11 Jul 2031\n- Site: Lot 655-W, Gaspé\n- Supplier: ZZ-20U-3727\n- Cancelled\n- Rated capacity: 16.49 t\n- Calibration constant: 15.0054\n\nProject Lunlith-13:\n- Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n- Initial budget: 8,278,225 CAD\n- Revised budget: 8,244,865 CAD\n- Rejected on 17 Oct 2030\n- Site: Lot 247-S, Baie-Comeau\n- Supplier: DD-69N-1", | ||||
| 9 | + "7": "**Capital Projects Register, Issue 680**\n\nProjects listed: Sollith-7, Banurlun-13, Lunlith-18.\n\n**Project Sollith-4:**\n- Proposed by Priyamvada Sørlie on 15 Aug 2030\n- Initial budget: 6,914,937 CAD\n- Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n- Approved on 14 Feb 2031\n- Site: Lot 596-B, Chibougamau\n- Supplier: WT-26M-9227\n- Launch postponed to 25 May 2031\n- Rated capacity: 14.59 MW\n- Calibration constant: 72.7163\n\n**Project Banurlun-12:**\n- Proposed by Nnamdi Varga on 21 Feb 2031\n- Initial budget: 1,787,610 CAD\n- Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n- Approved on 11 Jul 2031\n- Site: Lot 655-W, Gaspé\n- Supplier: ZZ-20U-3727\n- Cancelled\n- Rated capacity: 16.49 t\n- Calibration constant: 15.0054\n\n**Project Lunlith-13:**\n- Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n- Initial budget: 8,278,225 CAD\n- Revised budget: 8,244,865 CAD\n- Rejected on 17 Oct 2030\n- Site: Lot 247-S, Baie-Comeau\n- Supplier: DD-69N-1", | ||||
| 10 | + "8": "**Capital Projects Register, Issue 680**\n\nThe document lists the following projects: Sollith-7, Banurlun-13, and Lunlith-18.\n\n**Project Sollith-4:**\n- Proposed by Priyamvada Sørlie on 15 Aug 2030\n- Initial budget: 6,914,937 CAD\n- Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n- Approved on 14 Feb 2031\n- Site: Lot 596-B, Chibougamau\n- Supplier: WT-26M-9227\n- Launch postponed to 25 May 2031\n- Rated capacity: 14.59 MW\n- Calibration constant: 72.7163\n\n**Project Banurlun-12:**\n- Proposed by Nnamdi Varga on 21 Feb 2031\n- Initial budget: 1,787,610 CAD\n- Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n- Approved on 11 Jul 2031\n- Site: Lot 655-W, Gaspé\n- Supplier: ZZ-20U-3727\n- Cancelled\n- Rated capacity: 16.49 t\n- Calibration constant: 15.0054\n\n**Project Lunlith-13:**\n- Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n- Initial budget: 8,278,225 CAD\n- Revised budget: 8,244,865 CAD\n- Rejected on 17 Oct 2030\n- Site: Lot 247-S, Baie-Comeau\n- Supplier: DD-69N-1" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6872.302875039168, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2071, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 724.335459060967, | ||||
| 20 | + "sender_ttft_ms": 12.188499909825623, | ||||
| 21 | + "sender_decode_ms": 6133.51145805791 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 63, | ||||
| 29 | + "facts_retained": 27, | ||||
| 30 | + "retention_rate": 0.42857142857142855, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.5, | ||||
| 33 | + "date": 0.125, | ||||
| 34 | + "amount": 0.6153846153846154, | ||||
| 35 | + "status": 0.75, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.3333333333333333, | ||||
| 38 | + "quantity": 0.3333333333333333 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 1087 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 5042.6992499269545, | ||||
| 48 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 557, | ||||
| 51 | + "sender_output_tokens": 416, | ||||
| 52 | + "sender_prefill_ms": 217.5022920127958, | ||||
| 53 | + "sender_ttft_ms": 11.783459107391536, | ||||
| 54 | + "sender_decode_ms": 4812.491957913153 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 0, | ||||
| 58 | + "fetched_bytes": 0 | ||||
| 59 | + }, | ||||
| 60 | + "ledger": { | ||||
| 61 | + "facts_total": 63, | ||||
| 62 | + "facts_retained": 24, | ||||
| 63 | + "retention_rate": 0.38095238095238093, | ||||
| 64 | + "retention_by_kind": { | ||||
| 65 | + "person": 0.5, | ||||
| 66 | + "date": 0.125, | ||||
| 67 | + "amount": 0.6153846153846154, | ||||
| 68 | + "status": 0.5, | ||||
| 69 | + "place": 0.0, | ||||
| 70 | + "identifier": 0.3333333333333333, | ||||
| 71 | + "quantity": 0.3333333333333333 | ||||
| 72 | + }, | ||||
| 73 | + "unsupported_numbers": 0, | ||||
| 74 | + "unsupported_identifiers": 0, | ||||
| 75 | + "distorted_sentences": 0, | ||||
| 76 | + "message_bytes": 1063 | ||||
| 77 | + } | ||||
| 78 | + }, | ||||
| 79 | + "3": { | ||||
| 80 | + "hop_ms": 6354.470000020228, | ||||
| 81 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 82 | + "usage": { | ||||
| 83 | + "sender_input_tokens": 625, | ||||
| 84 | + "sender_output_tokens": 508, | ||||
| 85 | + "sender_prefill_ms": 234.4789169728756, | ||||
| 86 | + "sender_ttft_ms": 12.088250019587576, | ||||
| 87 | + "sender_decode_ms": 6107.029624981806 | ||||
| 88 | + }, | ||||
| 89 | + "repair": { | ||||
| 90 | + "lookups": 0, | ||||
| 91 | + "fetched_bytes": 0 | ||||
| 92 | + }, | ||||
| 93 | + "ledger": { | ||||
| 94 | + "facts_total": 63, | ||||
| 95 | + "facts_retained": 24, | ||||
| 96 | + "retention_rate": 0.38095238095238093, | ||||
| 97 | + "retention_by_kind": { | ||||
| 98 | + "person": 0.5, | ||||
| 99 | + "date": 0.125, | ||||
| 100 | + "amount": 0.6153846153846154, | ||||
| 101 | + "status": 0.5, | ||||
| 102 | + "place": 0.0, | ||||
| 103 | + "identifier": 0.3333333333333333, | ||||
| 104 | + "quantity": 0.3333333333333333 | ||||
| 105 | + }, | ||||
| 106 | + "unsupported_numbers": 0, | ||||
| 107 | + "unsupported_identifiers": 0, | ||||
| 108 | + "distorted_sentences": 0, | ||||
| 109 | + "message_bytes": 1062 | ||||
| 110 | + } | ||||
| 111 | + }, | ||||
| 112 | + "4": { | ||||
| 113 | + "hop_ms": 4713.825125014409, | ||||
| 114 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 115 | + "usage": { | ||||
| 116 | + "sender_input_tokens": 553, | ||||
| 117 | + "sender_output_tokens": 387, | ||||
| 118 | + "sender_prefill_ms": 219.6284580277279, | ||||
| 119 | + "sender_ttft_ms": 11.779417051002383, | ||||
| 120 | + "sender_decode_ms": 4481.513542006724 | ||||
| 121 | + }, | ||||
| 122 | + "repair": { | ||||
| 123 | + "lookups": 0, | ||||
| 124 | + "fetched_bytes": 0 | ||||
| 125 | + }, | ||||
| 126 | + "ledger": { | ||||
| 127 | + "facts_total": 63, | ||||
| 128 | + "facts_retained": 24, | ||||
| 129 | + "retention_rate": 0.38095238095238093, | ||||
| 130 | + "retention_by_kind": { | ||||
| 131 | + "person": 0.5, | ||||
| 132 | + "date": 0.125, | ||||
| 133 | + "amount": 0.6153846153846154, | ||||
| 134 | + "status": 0.5, | ||||
| 135 | + "place": 0.0, | ||||
| 136 | + "identifier": 0.3333333333333333, | ||||
| 137 | + "quantity": 0.3333333333333333 | ||||
| 138 | + }, | ||||
| 139 | + "unsupported_numbers": 0, | ||||
| 140 | + "unsupported_identifiers": 0, | ||||
| 141 | + "distorted_sentences": 0, | ||||
| 142 | + "message_bytes": 1023 | ||||
| 143 | + } | ||||
| 144 | + }, | ||||
| 145 | + "5": { | ||||
| 146 | + "hop_ms": 6335.791665944271, | ||||
| 147 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 148 | + "usage": { | ||||
| 149 | + "sender_input_tokens": 596, | ||||
| 150 | + "sender_output_tokens": 503, | ||||
| 151 | + "sender_prefill_ms": 231.13220906816423, | ||||
| 152 | + "sender_ttft_ms": 12.182750040665269, | ||||
| 153 | + "sender_decode_ms": 6091.590458061546 | ||||
| 154 | + }, | ||||
| 155 | + "repair": { | ||||
| 156 | + "lookups": 0, | ||||
| 157 | + "fetched_bytes": 0 | ||||
| 158 | + }, | ||||
| 159 | + "ledger": { | ||||
| 160 | + "facts_total": 63, | ||||
| 161 | + "facts_retained": 24, | ||||
| 162 | + "retention_rate": 0.38095238095238093, | ||||
| 163 | + "retention_by_kind": { | ||||
| 164 | + "person": 0.5, | ||||
| 165 | + "date": 0.125, | ||||
| 166 | + "amount": 0.6153846153846154, | ||||
| 167 | + "status": 0.5, | ||||
| 168 | + "place": 0.0, | ||||
| 169 | + "identifier": 0.3333333333333333, | ||||
| 170 | + "quantity": 0.3333333333333333 | ||||
| 171 | + }, | ||||
| 172 | + "unsupported_numbers": 0, | ||||
| 173 | + "unsupported_identifiers": 0, | ||||
| 174 | + "distorted_sentences": 0, | ||||
| 175 | + "message_bytes": 1050 | ||||
| 176 | + } | ||||
| 177 | + }, | ||||
| 178 | + "6": { | ||||
| 179 | + "hop_ms": 4672.110749990679, | ||||
| 180 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 181 | + "usage": { | ||||
| 182 | + "sender_input_tokens": 548, | ||||
| 183 | + "sender_output_tokens": 382, | ||||
| 184 | + "sender_prefill_ms": 217.53291704226285, | ||||
| 185 | + "sender_ttft_ms": 11.919083073735237, | ||||
| 186 | + "sender_decode_ms": 4441.786083043553 | ||||
| 187 | + }, | ||||
| 188 | + "repair": { | ||||
| 189 | + "lookups": 0, | ||||
| 190 | + "fetched_bytes": 0 | ||||
| 191 | + }, | ||||
| 192 | + "ledger": { | ||||
| 193 | + "facts_total": 63, | ||||
| 194 | + "facts_retained": 24, | ||||
| 195 | + "retention_rate": 0.38095238095238093, | ||||
| 196 | + "retention_by_kind": { | ||||
| 197 | + "person": 0.5, | ||||
| 198 | + "date": 0.125, | ||||
| 199 | + "amount": 0.6153846153846154, | ||||
| 200 | + "status": 0.5, | ||||
| 201 | + "place": 0.0, | ||||
| 202 | + "identifier": 0.3333333333333333, | ||||
| 203 | + "quantity": 0.3333333333333333 | ||||
| 204 | + }, | ||||
| 205 | + "unsupported_numbers": 0, | ||||
| 206 | + "unsupported_identifiers": 0, | ||||
| 207 | + "distorted_sentences": 0, | ||||
| 208 | + "message_bytes": 1010 | ||||
| 209 | + } | ||||
| 210 | + }, | ||||
| 211 | + "7": { | ||||
| 212 | + "hop_ms": 5924.405542085879, | ||||
| 213 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 214 | + "usage": { | ||||
| 215 | + "sender_input_tokens": 591, | ||||
| 216 | + "sender_output_tokens": 474, | ||||
| 217 | + "sender_prefill_ms": 231.612709001638, | ||||
| 218 | + "sender_ttft_ms": 12.200874974951148, | ||||
| 219 | + "sender_decode_ms": 5679.758875048719 | ||||
| 220 | + }, | ||||
| 221 | + "repair": { | ||||
| 222 | + "lookups": 0, | ||||
| 223 | + "fetched_bytes": 0 | ||||
| 224 | + }, | ||||
| 225 | + "ledger": { | ||||
| 226 | + "facts_total": 63, | ||||
| 227 | + "facts_retained": 24, | ||||
| 228 | + "retention_rate": 0.38095238095238093, | ||||
| 229 | + "retention_by_kind": { | ||||
| 230 | + "person": 0.5, | ||||
| 231 | + "date": 0.125, | ||||
| 232 | + "amount": 0.6153846153846154, | ||||
| 233 | + "status": 0.5, | ||||
| 234 | + "place": 0.0, | ||||
| 235 | + "identifier": 0.3333333333333333, | ||||
| 236 | + "quantity": 0.3333333333333333 | ||||
| 237 | + }, | ||||
| 238 | + "unsupported_numbers": 0, | ||||
| 239 | + "unsupported_identifiers": 0, | ||||
| 240 | + "distorted_sentences": 0, | ||||
| 241 | + "message_bytes": 992 | ||||
| 242 | + } | ||||
| 243 | + }, | ||||
| 244 | + "8": { | ||||
| 245 | + "hop_ms": 4708.999749971554, | ||||
| 246 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 247 | + "usage": { | ||||
| 248 | + "sender_input_tokens": 519, | ||||
| 249 | + "sender_output_tokens": 387, | ||||
| 250 | + "sender_prefill_ms": 214.9976670043543, | ||||
| 251 | + "sender_ttft_ms": 11.605707928538322, | ||||
| 252 | + "sender_decode_ms": 4481.559166917577 | ||||
| 253 | + }, | ||||
| 254 | + "repair": { | ||||
| 255 | + "lookups": 0, | ||||
| 256 | + "fetched_bytes": 0 | ||||
| 257 | + }, | ||||
| 258 | + "ledger": { | ||||
| 259 | + "facts_total": 63, | ||||
| 260 | + "facts_retained": 24, | ||||
| 261 | + "retention_rate": 0.38095238095238093, | ||||
| 262 | + "retention_by_kind": { | ||||
| 263 | + "person": 0.5, | ||||
| 264 | + "date": 0.125, | ||||
| 265 | + "amount": 0.6153846153846154, | ||||
| 266 | + "status": 0.5, | ||||
| 267 | + "place": 0.0, | ||||
| 268 | + "identifier": 0.3333333333333333, | ||||
| 269 | + "quantity": 0.3333333333333333 | ||||
| 270 | + }, | ||||
| 271 | + "unsupported_numbers": 0, | ||||
| 272 | + "unsupported_identifiers": 0, | ||||
| 273 | + "distorted_sentences": 0, | ||||
| 274 | + "message_bytes": 1022 | ||||
| 275 | + } | ||||
| 276 | + } | ||||
| 277 | + } | ||||
| 278 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03027_2000_A4_repairable_qwen3b.json
+285 −0
@@ -0,0 +1,285 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 4 | + "2": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 5 | + "3": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 6 | + "4": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 7 | + "5": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 8 | + "6": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 9 | + "7": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1", | ||||
| 10 | + "8": "**Capital Projects Register, Issue 680**\n\n- **Proposals under review (no attributes recorded):**\n - Sollith-7, Banurlun-13, Lunlith-18\n\n- **Project Sollith-4:**\n - Proposed by Priyamvada Sørlie on 15 Aug 2030\n - Initial budget: 6,914,937 CAD\n - Revised budgets: 6,056,150 CAD (8 Oct 2030), 8,010,205 CAD (7 Jan 2031)\n - Approved on 14 Feb 2031\n - Site: Lot 596-B, Chibougamau\n - Supplier: WT-26M-9227\n - Launch postponed to 25 May 2031\n - Rated capacity: 14.59 MW\n - Calibration constant: 72.7163\n\n- **Project Banurlun-12:**\n - Proposed by Nnamdi Varga on 21 Feb 2031\n - Initial budget: 1,787,610 CAD\n - Revised budgets: 1,960,300 CAD (14 Jun 2031), 2,021,900 CAD (23 Jun 2031)\n - Approved on 11 Jul 2031\n - Site: Lot 655-W, Gaspé\n - Supplier: ZZ-20U-3727\n - Cancelled\n - Rated capacity: 16.49 t\n - Calibration constant: 15.0054\n\n- **Project Lunlith-13:**\n - Proposed by Wilhelmina Ouellet-Marchand on 22 Jul 2030\n - Initial budget: 8,278,225 CAD\n - Revised budget: 8,244,865 CAD\n - Rejected on 17 Oct 2030\n - Site: Lot 247-S, Baie-Comeau\n - Supplier: DD-69N-1" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6913.723333040252, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2071, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 725.2042919863015, | ||||
| 20 | + "sender_ttft_ms": 12.39933306351304, | ||||
| 21 | + "sender_decode_ms": 6174.01824996341 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 63, | ||||
| 29 | + "facts_retained": 27, | ||||
| 30 | + "retention_rate": 0.42857142857142855, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.5, | ||||
| 33 | + "date": 0.125, | ||||
| 34 | + "amount": 0.6153846153846154, | ||||
| 35 | + "status": 0.75, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.3333333333333333, | ||||
| 38 | + "quantity": 0.3333333333333333 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 1087 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 6537.521208985709, | ||||
| 48 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 1003, | ||||
| 51 | + "sender_output_tokens": 512, | ||||
| 52 | + "sender_prefill_ms": 359.9278749898076, | ||||
| 53 | + "sender_ttft_ms": 12.521625030785799, | ||||
| 54 | + "sender_decode_ms": 6163.765625096858 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 4, | ||||
| 58 | + "fetched_bytes": 854, | ||||
| 59 | + "codes_mentioned": 6 | ||||
| 60 | + }, | ||||
| 61 | + "ledger": { | ||||
| 62 | + "facts_total": 63, | ||||
| 63 | + "facts_retained": 27, | ||||
| 64 | + "retention_rate": 0.42857142857142855, | ||||
| 65 | + "retention_by_kind": { | ||||
| 66 | + "person": 0.5, | ||||
| 67 | + "date": 0.125, | ||||
| 68 | + "amount": 0.6153846153846154, | ||||
| 69 | + "status": 0.75, | ||||
| 70 | + "place": 0.0, | ||||
| 71 | + "identifier": 0.3333333333333333, | ||||
| 72 | + "quantity": 0.3333333333333333 | ||||
| 73 | + }, | ||||
| 74 | + "unsupported_numbers": 0, | ||||
| 75 | + "unsupported_identifiers": 0, | ||||
| 76 | + "distorted_sentences": 0, | ||||
| 77 | + "message_bytes": 1087 | ||||
| 78 | + } | ||||
| 79 | + }, | ||||
| 80 | + "3": { | ||||
| 81 | + "hop_ms": 6488.541791914031, | ||||
| 82 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 83 | + "usage": { | ||||
| 84 | + "sender_input_tokens": 1003, | ||||
| 85 | + "sender_output_tokens": 512, | ||||
| 86 | + "sender_prefill_ms": 358.5395839763805, | ||||
| 87 | + "sender_ttft_ms": 12.327584088779986, | ||||
| 88 | + "sender_decode_ms": 6116.433207993396 | ||||
| 89 | + }, | ||||
| 90 | + "repair": { | ||||
| 91 | + "lookups": 4, | ||||
| 92 | + "fetched_bytes": 854, | ||||
| 93 | + "codes_mentioned": 6 | ||||
| 94 | + }, | ||||
| 95 | + "ledger": { | ||||
| 96 | + "facts_total": 63, | ||||
| 97 | + "facts_retained": 27, | ||||
| 98 | + "retention_rate": 0.42857142857142855, | ||||
| 99 | + "retention_by_kind": { | ||||
| 100 | + "person": 0.5, | ||||
| 101 | + "date": 0.125, | ||||
| 102 | + "amount": 0.6153846153846154, | ||||
| 103 | + "status": 0.75, | ||||
| 104 | + "place": 0.0, | ||||
| 105 | + "identifier": 0.3333333333333333, | ||||
| 106 | + "quantity": 0.3333333333333333 | ||||
| 107 | + }, | ||||
| 108 | + "unsupported_numbers": 0, | ||||
| 109 | + "unsupported_identifiers": 0, | ||||
| 110 | + "distorted_sentences": 0, | ||||
| 111 | + "message_bytes": 1087 | ||||
| 112 | + } | ||||
| 113 | + }, | ||||
| 114 | + "4": { | ||||
| 115 | + "hop_ms": 6486.346457968466, | ||||
| 116 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 117 | + "usage": { | ||||
| 118 | + "sender_input_tokens": 1003, | ||||
| 119 | + "sender_output_tokens": 512, | ||||
| 120 | + "sender_prefill_ms": 358.0603749724105, | ||||
| 121 | + "sender_ttft_ms": 12.322707916609943, | ||||
| 122 | + "sender_decode_ms": 6114.659500075504 | ||||
| 123 | + }, | ||||
| 124 | + "repair": { | ||||
| 125 | + "lookups": 4, | ||||
| 126 | + "fetched_bytes": 854, | ||||
| 127 | + "codes_mentioned": 6 | ||||
| 128 | + }, | ||||
| 129 | + "ledger": { | ||||
| 130 | + "facts_total": 63, | ||||
| 131 | + "facts_retained": 27, | ||||
| 132 | + "retention_rate": 0.42857142857142855, | ||||
| 133 | + "retention_by_kind": { | ||||
| 134 | + "person": 0.5, | ||||
| 135 | + "date": 0.125, | ||||
| 136 | + "amount": 0.6153846153846154, | ||||
| 137 | + "status": 0.75, | ||||
| 138 | + "place": 0.0, | ||||
| 139 | + "identifier": 0.3333333333333333, | ||||
| 140 | + "quantity": 0.3333333333333333 | ||||
| 141 | + }, | ||||
| 142 | + "unsupported_numbers": 0, | ||||
| 143 | + "unsupported_identifiers": 0, | ||||
| 144 | + "distorted_sentences": 0, | ||||
| 145 | + "message_bytes": 1087 | ||||
| 146 | + } | ||||
| 147 | + }, | ||||
| 148 | + "5": { | ||||
| 149 | + "hop_ms": 6492.82487493474, | ||||
| 150 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 151 | + "usage": { | ||||
| 152 | + "sender_input_tokens": 1003, | ||||
| 153 | + "sender_output_tokens": 512, | ||||
| 154 | + "sender_prefill_ms": 358.52187499403954, | ||||
| 155 | + "sender_ttft_ms": 12.218584073707461, | ||||
| 156 | + "sender_decode_ms": 6120.818041963503 | ||||
| 157 | + }, | ||||
| 158 | + "repair": { | ||||
| 159 | + "lookups": 4, | ||||
| 160 | + "fetched_bytes": 854, | ||||
| 161 | + "codes_mentioned": 6 | ||||
| 162 | + }, | ||||
| 163 | + "ledger": { | ||||
| 164 | + "facts_total": 63, | ||||
| 165 | + "facts_retained": 27, | ||||
| 166 | + "retention_rate": 0.42857142857142855, | ||||
| 167 | + "retention_by_kind": { | ||||
| 168 | + "person": 0.5, | ||||
| 169 | + "date": 0.125, | ||||
| 170 | + "amount": 0.6153846153846154, | ||||
| 171 | + "status": 0.75, | ||||
| 172 | + "place": 0.0, | ||||
| 173 | + "identifier": 0.3333333333333333, | ||||
| 174 | + "quantity": 0.3333333333333333 | ||||
| 175 | + }, | ||||
| 176 | + "unsupported_numbers": 0, | ||||
| 177 | + "unsupported_identifiers": 0, | ||||
| 178 | + "distorted_sentences": 0, | ||||
| 179 | + "message_bytes": 1087 | ||||
| 180 | + } | ||||
| 181 | + }, | ||||
| 182 | + "6": { | ||||
| 183 | + "hop_ms": 6482.172666001134, | ||||
| 184 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 185 | + "usage": { | ||||
| 186 | + "sender_input_tokens": 1003, | ||||
| 187 | + "sender_output_tokens": 512, | ||||
| 188 | + "sender_prefill_ms": 358.52616594638675, | ||||
| 189 | + "sender_ttft_ms": 12.34908401966095, | ||||
| 190 | + "sender_decode_ms": 6110.066291992553 | ||||
| 191 | + }, | ||||
| 192 | + "repair": { | ||||
| 193 | + "lookups": 4, | ||||
| 194 | + "fetched_bytes": 854, | ||||
| 195 | + "codes_mentioned": 6 | ||||
| 196 | + }, | ||||
| 197 | + "ledger": { | ||||
| 198 | + "facts_total": 63, | ||||
| 199 | + "facts_retained": 27, | ||||
| 200 | + "retention_rate": 0.42857142857142855, | ||||
| 201 | + "retention_by_kind": { | ||||
| 202 | + "person": 0.5, | ||||
| 203 | + "date": 0.125, | ||||
| 204 | + "amount": 0.6153846153846154, | ||||
| 205 | + "status": 0.75, | ||||
| 206 | + "place": 0.0, | ||||
| 207 | + "identifier": 0.3333333333333333, | ||||
| 208 | + "quantity": 0.3333333333333333 | ||||
| 209 | + }, | ||||
| 210 | + "unsupported_numbers": 0, | ||||
| 211 | + "unsupported_identifiers": 0, | ||||
| 212 | + "distorted_sentences": 0, | ||||
| 213 | + "message_bytes": 1087 | ||||
| 214 | + } | ||||
| 215 | + }, | ||||
| 216 | + "7": { | ||||
| 217 | + "hop_ms": 6484.1609169961885, | ||||
| 218 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 219 | + "usage": { | ||||
| 220 | + "sender_input_tokens": 1003, | ||||
| 221 | + "sender_output_tokens": 512, | ||||
| 222 | + "sender_prefill_ms": 358.5662499535829, | ||||
| 223 | + "sender_ttft_ms": 12.488791020587087, | ||||
| 224 | + "sender_decode_ms": 6111.858124961145 | ||||
| 225 | + }, | ||||
| 226 | + "repair": { | ||||
| 227 | + "lookups": 4, | ||||
| 228 | + "fetched_bytes": 854, | ||||
| 229 | + "codes_mentioned": 6 | ||||
| 230 | + }, | ||||
| 231 | + "ledger": { | ||||
| 232 | + "facts_total": 63, | ||||
| 233 | + "facts_retained": 27, | ||||
| 234 | + "retention_rate": 0.42857142857142855, | ||||
| 235 | + "retention_by_kind": { | ||||
| 236 | + "person": 0.5, | ||||
| 237 | + "date": 0.125, | ||||
| 238 | + "amount": 0.6153846153846154, | ||||
| 239 | + "status": 0.75, | ||||
| 240 | + "place": 0.0, | ||||
| 241 | + "identifier": 0.3333333333333333, | ||||
| 242 | + "quantity": 0.3333333333333333 | ||||
| 243 | + }, | ||||
| 244 | + "unsupported_numbers": 0, | ||||
| 245 | + "unsupported_identifiers": 0, | ||||
| 246 | + "distorted_sentences": 0, | ||||
| 247 | + "message_bytes": 1087 | ||||
| 248 | + } | ||||
| 249 | + }, | ||||
| 250 | + "8": { | ||||
| 251 | + "hop_ms": 6496.52524990961, | ||||
| 252 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 253 | + "usage": { | ||||
| 254 | + "sender_input_tokens": 1003, | ||||
| 255 | + "sender_output_tokens": 512, | ||||
| 256 | + "sender_prefill_ms": 358.3060000091791, | ||||
| 257 | + "sender_ttft_ms": 12.46287499088794, | ||||
| 258 | + "sender_decode_ms": 6124.515749979764 | ||||
| 259 | + }, | ||||
| 260 | + "repair": { | ||||
| 261 | + "lookups": 4, | ||||
| 262 | + "fetched_bytes": 854, | ||||
| 263 | + "codes_mentioned": 6 | ||||
| 264 | + }, | ||||
| 265 | + "ledger": { | ||||
| 266 | + "facts_total": 63, | ||||
| 267 | + "facts_retained": 27, | ||||
| 268 | + "retention_rate": 0.42857142857142855, | ||||
| 269 | + "retention_by_kind": { | ||||
| 270 | + "person": 0.5, | ||||
| 271 | + "date": 0.125, | ||||
| 272 | + "amount": 0.6153846153846154, | ||||
| 273 | + "status": 0.75, | ||||
| 274 | + "place": 0.0, | ||||
| 275 | + "identifier": 0.3333333333333333, | ||||
| 276 | + "quantity": 0.3333333333333333 | ||||
| 277 | + }, | ||||
| 278 | + "unsupported_numbers": 0, | ||||
| 279 | + "unsupported_identifiers": 0, | ||||
| 280 | + "distorted_sentences": 0, | ||||
| 281 | + "message_bytes": 1087 | ||||
| 282 | + } | ||||
| 283 | + } | ||||
| 284 | + } | ||||
| 285 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03027_2000_A5_closed_qwen3b.json
+278 −0
@@ -0,0 +1,278 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}]}", | ||||
| 4 | + "2": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}]}", | ||||
| 5 | + "3": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}]}", | ||||
| 6 | + "4": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}]}", | ||||
| 7 | + "5": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}]}", | ||||
| 8 | + "6": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}]}", | ||||
| 9 | + "7": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}]}", | ||||
| 10 | + "8": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}]}" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6880.990542005748, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2099, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 730.3528330521658, | ||||
| 20 | + "sender_ttft_ms": 12.13316700886935, | ||||
| 21 | + "sender_decode_ms": 6136.4223749842495 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 63, | ||||
| 29 | + "facts_retained": 9, | ||||
| 30 | + "retention_rate": 0.14285714285714285, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.16666666666666666, | ||||
| 33 | + "date": 0.25, | ||||
| 34 | + "amount": 0.07692307692307693, | ||||
| 35 | + "status": 0.25, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.08333333333333333, | ||||
| 38 | + "quantity": 0.16666666666666666 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 787 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 3875.456750043668, | ||||
| 48 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 514, | ||||
| 51 | + "sender_output_tokens": 306, | ||||
| 52 | + "sender_prefill_ms": 210.2135419845581, | ||||
| 53 | + "sender_ttft_ms": 12.034250074066222, | ||||
| 54 | + "sender_decode_ms": 3652.411708026193 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 0, | ||||
| 58 | + "fetched_bytes": 0 | ||||
| 59 | + }, | ||||
| 60 | + "ledger": { | ||||
| 61 | + "facts_total": 63, | ||||
| 62 | + "facts_retained": 8, | ||||
| 63 | + "retention_rate": 0.12698412698412698, | ||||
| 64 | + "retention_by_kind": { | ||||
| 65 | + "person": 0.16666666666666666, | ||||
| 66 | + "date": 0.125, | ||||
| 67 | + "amount": 0.07692307692307693, | ||||
| 68 | + "status": 0.25, | ||||
| 69 | + "place": 0.0, | ||||
| 70 | + "identifier": 0.08333333333333333, | ||||
| 71 | + "quantity": 0.16666666666666666 | ||||
| 72 | + }, | ||||
| 73 | + "unsupported_numbers": 0, | ||||
| 74 | + "unsupported_identifiers": 0, | ||||
| 75 | + "distorted_sentences": 0, | ||||
| 76 | + "message_bytes": 696 | ||||
| 77 | + } | ||||
| 78 | + }, | ||||
| 79 | + "3": { | ||||
| 80 | + "hop_ms": 3842.124249902554, | ||||
| 81 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 82 | + "usage": { | ||||
| 83 | + "sender_input_tokens": 479, | ||||
| 84 | + "sender_output_tokens": 306, | ||||
| 85 | + "sender_prefill_ms": 186.205624951981, | ||||
| 86 | + "sender_ttft_ms": 12.150916969403625, | ||||
| 87 | + "sender_decode_ms": 3643.0755408946425 | ||||
| 88 | + }, | ||||
| 89 | + "repair": { | ||||
| 90 | + "lookups": 0, | ||||
| 91 | + "fetched_bytes": 0 | ||||
| 92 | + }, | ||||
| 93 | + "ledger": { | ||||
| 94 | + "facts_total": 63, | ||||
| 95 | + "facts_retained": 8, | ||||
| 96 | + "retention_rate": 0.12698412698412698, | ||||
| 97 | + "retention_by_kind": { | ||||
| 98 | + "person": 0.16666666666666666, | ||||
| 99 | + "date": 0.125, | ||||
| 100 | + "amount": 0.07692307692307693, | ||||
| 101 | + "status": 0.25, | ||||
| 102 | + "place": 0.0, | ||||
| 103 | + "identifier": 0.08333333333333333, | ||||
| 104 | + "quantity": 0.16666666666666666 | ||||
| 105 | + }, | ||||
| 106 | + "unsupported_numbers": 0, | ||||
| 107 | + "unsupported_identifiers": 0, | ||||
| 108 | + "distorted_sentences": 0, | ||||
| 109 | + "message_bytes": 696 | ||||
| 110 | + } | ||||
| 111 | + }, | ||||
| 112 | + "4": { | ||||
| 113 | + "hop_ms": 3828.6825419636443, | ||||
| 114 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 115 | + "usage": { | ||||
| 116 | + "sender_input_tokens": 479, | ||||
| 117 | + "sender_output_tokens": 306, | ||||
| 118 | + "sender_prefill_ms": 185.93879195395857, | ||||
| 119 | + "sender_ttft_ms": 11.872667004354298, | ||||
| 120 | + "sender_decode_ms": 3630.121916066855 | ||||
| 121 | + }, | ||||
| 122 | + "repair": { | ||||
| 123 | + "lookups": 0, | ||||
| 124 | + "fetched_bytes": 0 | ||||
| 125 | + }, | ||||
| 126 | + "ledger": { | ||||
| 127 | + "facts_total": 63, | ||||
| 128 | + "facts_retained": 8, | ||||
| 129 | + "retention_rate": 0.12698412698412698, | ||||
| 130 | + "retention_by_kind": { | ||||
| 131 | + "person": 0.16666666666666666, | ||||
| 132 | + "date": 0.125, | ||||
| 133 | + "amount": 0.07692307692307693, | ||||
| 134 | + "status": 0.25, | ||||
| 135 | + "place": 0.0, | ||||
| 136 | + "identifier": 0.08333333333333333, | ||||
| 137 | + "quantity": 0.16666666666666666 | ||||
| 138 | + }, | ||||
| 139 | + "unsupported_numbers": 0, | ||||
| 140 | + "unsupported_identifiers": 0, | ||||
| 141 | + "distorted_sentences": 0, | ||||
| 142 | + "message_bytes": 696 | ||||
| 143 | + } | ||||
| 144 | + }, | ||||
| 145 | + "5": { | ||||
| 146 | + "hop_ms": 3843.770332983695, | ||||
| 147 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 148 | + "usage": { | ||||
| 149 | + "sender_input_tokens": 479, | ||||
| 150 | + "sender_output_tokens": 306, | ||||
| 151 | + "sender_prefill_ms": 185.70679205004126, | ||||
| 152 | + "sender_ttft_ms": 11.908292071893811, | ||||
| 153 | + "sender_decode_ms": 3645.4800410429016 | ||||
| 154 | + }, | ||||
| 155 | + "repair": { | ||||
| 156 | + "lookups": 0, | ||||
| 157 | + "fetched_bytes": 0 | ||||
| 158 | + }, | ||||
| 159 | + "ledger": { | ||||
| 160 | + "facts_total": 63, | ||||
| 161 | + "facts_retained": 8, | ||||
| 162 | + "retention_rate": 0.12698412698412698, | ||||
| 163 | + "retention_by_kind": { | ||||
| 164 | + "person": 0.16666666666666666, | ||||
| 165 | + "date": 0.125, | ||||
| 166 | + "amount": 0.07692307692307693, | ||||
| 167 | + "status": 0.25, | ||||
| 168 | + "place": 0.0, | ||||
| 169 | + "identifier": 0.08333333333333333, | ||||
| 170 | + "quantity": 0.16666666666666666 | ||||
| 171 | + }, | ||||
| 172 | + "unsupported_numbers": 0, | ||||
| 173 | + "unsupported_identifiers": 0, | ||||
| 174 | + "distorted_sentences": 0, | ||||
| 175 | + "message_bytes": 696 | ||||
| 176 | + } | ||||
| 177 | + }, | ||||
| 178 | + "6": { | ||||
| 179 | + "hop_ms": 3833.0124999629334, | ||||
| 180 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 181 | + "usage": { | ||||
| 182 | + "sender_input_tokens": 479, | ||||
| 183 | + "sender_output_tokens": 306, | ||||
| 184 | + "sender_prefill_ms": 185.95570791512728, | ||||
| 185 | + "sender_ttft_ms": 12.087499955669045, | ||||
| 186 | + "sender_decode_ms": 3634.1883750865236 | ||||
| 187 | + }, | ||||
| 188 | + "repair": { | ||||
| 189 | + "lookups": 0, | ||||
| 190 | + "fetched_bytes": 0 | ||||
| 191 | + }, | ||||
| 192 | + "ledger": { | ||||
| 193 | + "facts_total": 63, | ||||
| 194 | + "facts_retained": 8, | ||||
| 195 | + "retention_rate": 0.12698412698412698, | ||||
| 196 | + "retention_by_kind": { | ||||
| 197 | + "person": 0.16666666666666666, | ||||
| 198 | + "date": 0.125, | ||||
| 199 | + "amount": 0.07692307692307693, | ||||
| 200 | + "status": 0.25, | ||||
| 201 | + "place": 0.0, | ||||
| 202 | + "identifier": 0.08333333333333333, | ||||
| 203 | + "quantity": 0.16666666666666666 | ||||
| 204 | + }, | ||||
| 205 | + "unsupported_numbers": 0, | ||||
| 206 | + "unsupported_identifiers": 0, | ||||
| 207 | + "distorted_sentences": 0, | ||||
| 208 | + "message_bytes": 696 | ||||
| 209 | + } | ||||
| 210 | + }, | ||||
| 211 | + "7": { | ||||
| 212 | + "hop_ms": 3827.791125047952, | ||||
| 213 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 214 | + "usage": { | ||||
| 215 | + "sender_input_tokens": 479, | ||||
| 216 | + "sender_output_tokens": 306, | ||||
| 217 | + "sender_prefill_ms": 185.83779106847942, | ||||
| 218 | + "sender_ttft_ms": 11.92345900926739, | ||||
| 219 | + "sender_decode_ms": 3629.2197089642286 | ||||
| 220 | + }, | ||||
| 221 | + "repair": { | ||||
| 222 | + "lookups": 0, | ||||
| 223 | + "fetched_bytes": 0 | ||||
| 224 | + }, | ||||
| 225 | + "ledger": { | ||||
| 226 | + "facts_total": 63, | ||||
| 227 | + "facts_retained": 8, | ||||
| 228 | + "retention_rate": 0.12698412698412698, | ||||
| 229 | + "retention_by_kind": { | ||||
| 230 | + "person": 0.16666666666666666, | ||||
| 231 | + "date": 0.125, | ||||
| 232 | + "amount": 0.07692307692307693, | ||||
| 233 | + "status": 0.25, | ||||
| 234 | + "place": 0.0, | ||||
| 235 | + "identifier": 0.08333333333333333, | ||||
| 236 | + "quantity": 0.16666666666666666 | ||||
| 237 | + }, | ||||
| 238 | + "unsupported_numbers": 0, | ||||
| 239 | + "unsupported_identifiers": 0, | ||||
| 240 | + "distorted_sentences": 0, | ||||
| 241 | + "message_bytes": 696 | ||||
| 242 | + } | ||||
| 243 | + }, | ||||
| 244 | + "8": { | ||||
| 245 | + "hop_ms": 3839.710959000513, | ||||
| 246 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 247 | + "usage": { | ||||
| 248 | + "sender_input_tokens": 479, | ||||
| 249 | + "sender_output_tokens": 306, | ||||
| 250 | + "sender_prefill_ms": 185.9519579447806, | ||||
| 251 | + "sender_ttft_ms": 12.189582921564579, | ||||
| 252 | + "sender_decode_ms": 3640.7392090186477 | ||||
| 253 | + }, | ||||
| 254 | + "repair": { | ||||
| 255 | + "lookups": 0, | ||||
| 256 | + "fetched_bytes": 0 | ||||
| 257 | + }, | ||||
| 258 | + "ledger": { | ||||
| 259 | + "facts_total": 63, | ||||
| 260 | + "facts_retained": 8, | ||||
| 261 | + "retention_rate": 0.12698412698412698, | ||||
| 262 | + "retention_by_kind": { | ||||
| 263 | + "person": 0.16666666666666666, | ||||
| 264 | + "date": 0.125, | ||||
| 265 | + "amount": 0.07692307692307693, | ||||
| 266 | + "status": 0.25, | ||||
| 267 | + "place": 0.0, | ||||
| 268 | + "identifier": 0.08333333333333333, | ||||
| 269 | + "quantity": 0.16666666666666666 | ||||
| 270 | + }, | ||||
| 271 | + "unsupported_numbers": 0, | ||||
| 272 | + "unsupported_identifiers": 0, | ||||
| 273 | + "distorted_sentences": 0, | ||||
| 274 | + "message_bytes": 696 | ||||
| 275 | + } | ||||
| 276 | + } | ||||
| 277 | + } | ||||
| 278 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03027_2000_A5_closed_qwen3b_llama3b.json
+278 −0
@@ -0,0 +1,278 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}]}", | ||||
| 4 | + "2": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 5 | + "3": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 6 | + "4": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"quote\": \"Priyamvada Sørlie\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"quote\": \"6,914,937 CAD\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"quote\": \"15 August 2030\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"quote\": \"7 January 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"quote\": \"14 February 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"quote\": \"25 May 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"quote\": \"14.59 MW\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"quote\": \"WT-26M-9227\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 7 | + "5": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"quote\": \"Priyamvada Sørlie\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"quote\": \"6,914,937 CAD\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"quote\": \"15 August 2030\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"quote\": \"7 January 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"quote\": \"14 February 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"quote\": \"25 May 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"quote\": \"14.59 MW\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"quote\": \"WT-26M-9227\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 8 | + "6": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"quote\": \"Priyamvada Sørlie\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"quote\": \"6,914,937 CAD\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"quote\": \"15 August 2030\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"quote\": \"7 January 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"quote\": \"14 February 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"quote\": \"25 May 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"quote\": \"14.59 MW\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"quote\": \"WT-26M-9227\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 9 | + "7": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"quote\": \"Priyamvada Sørlie\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"quote\": \"6,914,937 CAD\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"quote\": \"15 August 2030\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"quote\": \"7 January 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"quote\": \"14 February 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"quote\": \"25 May 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"quote\": \"14.59 MW\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"quote\": \"WT-26M-9227\"}], \"notes\": \"\", \"unknowns\": []}", | ||||
| 10 | + "8": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"quote\": \"Priyamvada Sørlie\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"quote\": \"6,914,937 CAD\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"quote\": \"15 August 2030\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"quote\": \"7 January 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"quote\": \"14 February 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"quote\": \"25 May 2031\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"quote\": \"14.59 MW\"}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"quote\": \"WT-26M-9227\"}], \"notes\": \"\", \"unknowns\": []}" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6902.532499982044, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2099, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 734.4805840402842, | ||||
| 20 | + "sender_ttft_ms": 12.054082937538624, | ||||
| 21 | + "sender_decode_ms": 6153.658750001341 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 63, | ||||
| 29 | + "facts_retained": 9, | ||||
| 30 | + "retention_rate": 0.14285714285714285, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.16666666666666666, | ||||
| 33 | + "date": 0.25, | ||||
| 34 | + "amount": 0.07692307692307693, | ||||
| 35 | + "status": 0.25, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.08333333333333333, | ||||
| 38 | + "quantity": 0.16666666666666666 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 787 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 3721.2153329746798, | ||||
| 48 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 494, | ||||
| 51 | + "sender_output_tokens": 302, | ||||
| 52 | + "sender_prefill_ms": 212.69908302929252, | ||||
| 53 | + "sender_ttft_ms": 11.657541035674512, | ||||
| 54 | + "sender_decode_ms": 3496.065375045873 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 0, | ||||
| 58 | + "fetched_bytes": 0 | ||||
| 59 | + }, | ||||
| 60 | + "ledger": { | ||||
| 61 | + "facts_total": 63, | ||||
| 62 | + "facts_retained": 12, | ||||
| 63 | + "retention_rate": 0.19047619047619047, | ||||
| 64 | + "retention_by_kind": { | ||||
| 65 | + "person": 0.16666666666666666, | ||||
| 66 | + "date": 0.25, | ||||
| 67 | + "amount": 0.07692307692307693, | ||||
| 68 | + "status": 0.5, | ||||
| 69 | + "place": 0.0, | ||||
| 70 | + "identifier": 0.08333333333333333, | ||||
| 71 | + "quantity": 0.16666666666666666 | ||||
| 72 | + }, | ||||
| 73 | + "unsupported_numbers": 0, | ||||
| 74 | + "unsupported_identifiers": 0, | ||||
| 75 | + "distorted_sentences": 0, | ||||
| 76 | + "message_bytes": 816 | ||||
| 77 | + } | ||||
| 78 | + }, | ||||
| 79 | + "3": { | ||||
| 80 | + "hop_ms": 4287.0670419652015, | ||||
| 81 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 82 | + "usage": { | ||||
| 83 | + "sender_input_tokens": 523, | ||||
| 84 | + "sender_output_tokens": 339, | ||||
| 85 | + "sender_prefill_ms": 215.07670893333852, | ||||
| 86 | + "sender_ttft_ms": 11.98062498588115, | ||||
| 87 | + "sender_decode_ms": 4059.233459061943 | ||||
| 88 | + }, | ||||
| 89 | + "repair": { | ||||
| 90 | + "lookups": 0, | ||||
| 91 | + "fetched_bytes": 0 | ||||
| 92 | + }, | ||||
| 93 | + "ledger": { | ||||
| 94 | + "facts_total": 63, | ||||
| 95 | + "facts_retained": 12, | ||||
| 96 | + "retention_rate": 0.19047619047619047, | ||||
| 97 | + "retention_by_kind": { | ||||
| 98 | + "person": 0.16666666666666666, | ||||
| 99 | + "date": 0.25, | ||||
| 100 | + "amount": 0.07692307692307693, | ||||
| 101 | + "status": 0.5, | ||||
| 102 | + "place": 0.0, | ||||
| 103 | + "identifier": 0.08333333333333333, | ||||
| 104 | + "quantity": 0.16666666666666666 | ||||
| 105 | + }, | ||||
| 106 | + "unsupported_numbers": 0, | ||||
| 107 | + "unsupported_identifiers": 0, | ||||
| 108 | + "distorted_sentences": 0, | ||||
| 109 | + "message_bytes": 816 | ||||
| 110 | + } | ||||
| 111 | + }, | ||||
| 112 | + "4": { | ||||
| 113 | + "hop_ms": 4065.009665908292, | ||||
| 114 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 115 | + "usage": { | ||||
| 116 | + "sender_input_tokens": 503, | ||||
| 117 | + "sender_output_tokens": 331, | ||||
| 118 | + "sender_prefill_ms": 216.62254200782627, | ||||
| 119 | + "sender_ttft_ms": 11.782374931499362, | ||||
| 120 | + "sender_decode_ms": 3835.793250007555 | ||||
| 121 | + }, | ||||
| 122 | + "repair": { | ||||
| 123 | + "lookups": 0, | ||||
| 124 | + "fetched_bytes": 0 | ||||
| 125 | + }, | ||||
| 126 | + "ledger": { | ||||
| 127 | + "facts_total": 63, | ||||
| 128 | + "facts_retained": 12, | ||||
| 129 | + "retention_rate": 0.19047619047619047, | ||||
| 130 | + "retention_by_kind": { | ||||
| 131 | + "person": 0.16666666666666666, | ||||
| 132 | + "date": 0.25, | ||||
| 133 | + "amount": 0.07692307692307693, | ||||
| 134 | + "status": 0.5, | ||||
| 135 | + "place": 0.0, | ||||
| 136 | + "identifier": 0.08333333333333333, | ||||
| 137 | + "quantity": 0.16666666666666666 | ||||
| 138 | + }, | ||||
| 139 | + "unsupported_numbers": 0, | ||||
| 140 | + "unsupported_identifiers": 0, | ||||
| 141 | + "distorted_sentences": 0, | ||||
| 142 | + "message_bytes": 923 | ||||
| 143 | + } | ||||
| 144 | + }, | ||||
| 145 | + "5": { | ||||
| 146 | + "hop_ms": 4598.389083053917, | ||||
| 147 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 148 | + "usage": { | ||||
| 149 | + "sender_input_tokens": 549, | ||||
| 150 | + "sender_output_tokens": 365, | ||||
| 151 | + "sender_prefill_ms": 215.74633405543864, | ||||
| 152 | + "sender_ttft_ms": 12.036083964630961, | ||||
| 153 | + "sender_decode_ms": 4369.757457985543 | ||||
| 154 | + }, | ||||
| 155 | + "repair": { | ||||
| 156 | + "lookups": 0, | ||||
| 157 | + "fetched_bytes": 0 | ||||
| 158 | + }, | ||||
| 159 | + "ledger": { | ||||
| 160 | + "facts_total": 63, | ||||
| 161 | + "facts_retained": 12, | ||||
| 162 | + "retention_rate": 0.19047619047619047, | ||||
| 163 | + "retention_by_kind": { | ||||
| 164 | + "person": 0.16666666666666666, | ||||
| 165 | + "date": 0.25, | ||||
| 166 | + "amount": 0.07692307692307693, | ||||
| 167 | + "status": 0.5, | ||||
| 168 | + "place": 0.0, | ||||
| 169 | + "identifier": 0.08333333333333333, | ||||
| 170 | + "quantity": 0.16666666666666666 | ||||
| 171 | + }, | ||||
| 172 | + "unsupported_numbers": 0, | ||||
| 173 | + "unsupported_identifiers": 0, | ||||
| 174 | + "distorted_sentences": 0, | ||||
| 175 | + "message_bytes": 923 | ||||
| 176 | + } | ||||
| 177 | + }, | ||||
| 178 | + "6": { | ||||
| 179 | + "hop_ms": 4072.139750001952, | ||||
| 180 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 181 | + "usage": { | ||||
| 182 | + "sender_input_tokens": 529, | ||||
| 183 | + "sender_output_tokens": 331, | ||||
| 184 | + "sender_prefill_ms": 221.1429999442771, | ||||
| 185 | + "sender_ttft_ms": 11.668750084936619, | ||||
| 186 | + "sender_decode_ms": 3838.498583994806 | ||||
| 187 | + }, | ||||
| 188 | + "repair": { | ||||
| 189 | + "lookups": 0, | ||||
| 190 | + "fetched_bytes": 0 | ||||
| 191 | + }, | ||||
| 192 | + "ledger": { | ||||
| 193 | + "facts_total": 63, | ||||
| 194 | + "facts_retained": 12, | ||||
| 195 | + "retention_rate": 0.19047619047619047, | ||||
| 196 | + "retention_by_kind": { | ||||
| 197 | + "person": 0.16666666666666666, | ||||
| 198 | + "date": 0.25, | ||||
| 199 | + "amount": 0.07692307692307693, | ||||
| 200 | + "status": 0.5, | ||||
| 201 | + "place": 0.0, | ||||
| 202 | + "identifier": 0.08333333333333333, | ||||
| 203 | + "quantity": 0.16666666666666666 | ||||
| 204 | + }, | ||||
| 205 | + "unsupported_numbers": 0, | ||||
| 206 | + "unsupported_identifiers": 0, | ||||
| 207 | + "distorted_sentences": 0, | ||||
| 208 | + "message_bytes": 923 | ||||
| 209 | + } | ||||
| 210 | + }, | ||||
| 211 | + "7": { | ||||
| 212 | + "hop_ms": 4599.793374887668, | ||||
| 213 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 214 | + "usage": { | ||||
| 215 | + "sender_input_tokens": 549, | ||||
| 216 | + "sender_output_tokens": 365, | ||||
| 217 | + "sender_prefill_ms": 214.22287507448345, | ||||
| 218 | + "sender_ttft_ms": 12.035374995321035, | ||||
| 219 | + "sender_decode_ms": 4372.719749924727 | ||||
| 220 | + }, | ||||
| 221 | + "repair": { | ||||
| 222 | + "lookups": 0, | ||||
| 223 | + "fetched_bytes": 0 | ||||
| 224 | + }, | ||||
| 225 | + "ledger": { | ||||
| 226 | + "facts_total": 63, | ||||
| 227 | + "facts_retained": 12, | ||||
| 228 | + "retention_rate": 0.19047619047619047, | ||||
| 229 | + "retention_by_kind": { | ||||
| 230 | + "person": 0.16666666666666666, | ||||
| 231 | + "date": 0.25, | ||||
| 232 | + "amount": 0.07692307692307693, | ||||
| 233 | + "status": 0.5, | ||||
| 234 | + "place": 0.0, | ||||
| 235 | + "identifier": 0.08333333333333333, | ||||
| 236 | + "quantity": 0.16666666666666666 | ||||
| 237 | + }, | ||||
| 238 | + "unsupported_numbers": 0, | ||||
| 239 | + "unsupported_identifiers": 0, | ||||
| 240 | + "distorted_sentences": 0, | ||||
| 241 | + "message_bytes": 923 | ||||
| 242 | + } | ||||
| 243 | + }, | ||||
| 244 | + "8": { | ||||
| 245 | + "hop_ms": 4074.102000100538, | ||||
| 246 | + "agent": "mlx-community/Llama-3.2-3B-Instruct-bf16", | ||||
| 247 | + "usage": { | ||||
| 248 | + "sender_input_tokens": 529, | ||||
| 249 | + "sender_output_tokens": 331, | ||||
| 250 | + "sender_prefill_ms": 218.042999971658, | ||||
| 251 | + "sender_ttft_ms": 11.669458937831223, | ||||
| 252 | + "sender_decode_ms": 3843.566375086084 | ||||
| 253 | + }, | ||||
| 254 | + "repair": { | ||||
| 255 | + "lookups": 0, | ||||
| 256 | + "fetched_bytes": 0 | ||||
| 257 | + }, | ||||
| 258 | + "ledger": { | ||||
| 259 | + "facts_total": 63, | ||||
| 260 | + "facts_retained": 12, | ||||
| 261 | + "retention_rate": 0.19047619047619047, | ||||
| 262 | + "retention_by_kind": { | ||||
| 263 | + "person": 0.16666666666666666, | ||||
| 264 | + "date": 0.25, | ||||
| 265 | + "amount": 0.07692307692307693, | ||||
| 266 | + "status": 0.5, | ||||
| 267 | + "place": 0.0, | ||||
| 268 | + "identifier": 0.08333333333333333, | ||||
| 269 | + "quantity": 0.16666666666666666 | ||||
| 270 | + }, | ||||
| 271 | + "unsupported_numbers": 0, | ||||
| 272 | + "unsupported_identifiers": 0, | ||||
| 273 | + "distorted_sentences": 0, | ||||
| 274 | + "message_bytes": 923 | ||||
| 275 | + } | ||||
| 276 | + } | ||||
| 277 | + } | ||||
| 278 | +} | ||||
| \ No newline at end of file | |||||
added
runs/raw/chains/E4_core_syn_03027_2000_A5_repairable_qwen3b.json
+285 −0
@@ -0,0 +1,285 @@ | |||||
| 1 | +{ | ||||
| 2 | + "hops": { | ||||
| 3 | + "1": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}]}", | ||||
| 4 | + "2": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}], \"unknowns\": [], \"notes\": null}", | ||||
| 5 | + "3": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}], \"unknowns\": [], \"notes\": null}", | ||||
| 6 | + "4": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}], \"unknowns\": [], \"notes\": null}", | ||||
| 7 | + "5": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}], \"unknowns\": [], \"notes\": null}", | ||||
| 8 | + "6": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}], \"unknowns\": [], \"notes\": null}", | ||||
| 9 | + "7": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}], \"unknowns\": [], \"notes\": null}", | ||||
| 10 | + "8": "{\"facts\": [{\"entity\": \"Sollith-4\", \"attribute\": \"proposed by\", \"value\": \"Priyamvada Sørlie\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"initial budget\", \"value\": \"6,914,937 CAD\", \"span\": [394, 433]}, {\"entity\": \"Sollith-4\", \"attribute\": \"first budget revision\", \"value\": \"15 August 2030\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"second budget revision\", \"value\": \"7 January 2031\", \"span\": [507, 577]}, {\"entity\": \"Sollith-4\", \"attribute\": \"approved decision\", \"value\": \"14 February 2031\", \"span\": [579, 647]}, {\"entity\": \"Sollith-4\", \"attribute\": \"launch date\", \"value\": \"25 May 2031\", \"span\": null}, {\"entity\": \"Sollith-4\", \"attribute\": \"rated capacity\", \"value\": \"14.59 MW\", \"span\": [824, 867]}, {\"entity\": \"Sollith-4\", \"attribute\": \"supplier identifier\", \"value\": \"WT-26M-9227\", \"span\": [700, 752]}], \"unknowns\": [], \"notes\": null}" | ||||
| 11 | + }, | ||||
| 12 | + "meta": { | ||||
| 13 | + "1": { | ||||
| 14 | + "hop_ms": 6904.5422920025885, | ||||
| 15 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 16 | + "usage": { | ||||
| 17 | + "sender_input_tokens": 2099, | ||||
| 18 | + "sender_output_tokens": 512, | ||||
| 19 | + "sender_prefill_ms": 730.2777499426156, | ||||
| 20 | + "sender_ttft_ms": 12.310000020079315, | ||||
| 21 | + "sender_decode_ms": 6159.614874981344 | ||||
| 22 | + }, | ||||
| 23 | + "repair": { | ||||
| 24 | + "lookups": 0, | ||||
| 25 | + "fetched_bytes": 0 | ||||
| 26 | + }, | ||||
| 27 | + "ledger": { | ||||
| 28 | + "facts_total": 63, | ||||
| 29 | + "facts_retained": 9, | ||||
| 30 | + "retention_rate": 0.14285714285714285, | ||||
| 31 | + "retention_by_kind": { | ||||
| 32 | + "person": 0.16666666666666666, | ||||
| 33 | + "date": 0.25, | ||||
| 34 | + "amount": 0.07692307692307693, | ||||
| 35 | + "status": 0.25, | ||||
| 36 | + "place": 0.0, | ||||
| 37 | + "identifier": 0.08333333333333333, | ||||
| 38 | + "quantity": 0.16666666666666666 | ||||
| 39 | + }, | ||||
| 40 | + "unsupported_numbers": 0, | ||||
| 41 | + "unsupported_identifiers": 0, | ||||
| 42 | + "distorted_sentences": 0, | ||||
| 43 | + "message_bytes": 787 | ||||
| 44 | + } | ||||
| 45 | + }, | ||||
| 46 | + "2": { | ||||
| 47 | + "hop_ms": 4380.263000028208, | ||||
| 48 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 49 | + "usage": { | ||||
| 50 | + "sender_input_tokens": 772, | ||||
| 51 | + "sender_output_tokens": 339, | ||||
| 52 | + "sender_prefill_ms": 285.6679999968037, | ||||
| 53 | + "sender_ttft_ms": 12.23570795264095, | ||||
| 54 | + "sender_decode_ms": 4081.2661660602316 | ||||
| 55 | + }, | ||||
| 56 | + "repair": { | ||||
| 57 | + "lookups": 1, | ||||
| 58 | + "fetched_bytes": 602, | ||||
| 59 | + "codes_mentioned": 1 | ||||
| 60 | + }, | ||||
| 61 | + "ledger": { | ||||
| 62 | + "facts_total": 63, | ||||
| 63 | + "facts_retained": 12, | ||||
| 64 | + "retention_rate": 0.19047619047619047, | ||||
| 65 | + "retention_by_kind": { | ||||
| 66 | + "person": 0.16666666666666666, | ||||
| 67 | + "date": 0.25, | ||||
| 68 | + "amount": 0.07692307692307693, | ||||
| 69 | + "status": 0.5, | ||||
| 70 | + "place": 0.0, | ||||
| 71 | + "identifier": 0.08333333333333333, | ||||
| 72 | + "quantity": 0.16666666666666666 | ||||
| 73 | + }, | ||||
| 74 | + "unsupported_numbers": 0, | ||||
| 75 | + "unsupported_identifiers": 0, | ||||
| 76 | + "distorted_sentences": 0, | ||||
| 77 | + "message_bytes": 818 | ||||
| 78 | + } | ||||
| 79 | + }, | ||||
| 80 | + "3": { | ||||
| 81 | + "hop_ms": 4375.677625066601, | ||||
| 82 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 83 | + "usage": { | ||||
| 84 | + "sender_input_tokens": 781, | ||||
| 85 | + "sender_output_tokens": 339, | ||||
| 86 | + "sender_prefill_ms": 290.6058339867741, | ||||
| 87 | + "sender_ttft_ms": 12.180375051684678, | ||||
| 88 | + "sender_decode_ms": 4071.7556671006605 | ||||
| 89 | + }, | ||||
| 90 | + "repair": { | ||||
| 91 | + "lookups": 1, | ||||
| 92 | + "fetched_bytes": 602, | ||||
| 93 | + "codes_mentioned": 1 | ||||
| 94 | + }, | ||||
| 95 | + "ledger": { | ||||
| 96 | + "facts_total": 63, | ||||
| 97 | + "facts_retained": 12, | ||||
| 98 | + "retention_rate": 0.19047619047619047, | ||||
| 99 | + "retention_by_kind": { | ||||
| 100 | + "person": 0.16666666666666666, | ||||
| 101 | + "date": 0.25, | ||||
| 102 | + "amount": 0.07692307692307693, | ||||
| 103 | + "status": 0.5, | ||||
| 104 | + "place": 0.0, | ||||
| 105 | + "identifier": 0.08333333333333333, | ||||
| 106 | + "quantity": 0.16666666666666666 | ||||
| 107 | + }, | ||||
| 108 | + "unsupported_numbers": 0, | ||||
| 109 | + "unsupported_identifiers": 0, | ||||
| 110 | + "distorted_sentences": 0, | ||||
| 111 | + "message_bytes": 818 | ||||
| 112 | + } | ||||
| 113 | + }, | ||||
| 114 | + "4": { | ||||
| 115 | + "hop_ms": 4371.123000048101, | ||||
| 116 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 117 | + "usage": { | ||||
| 118 | + "sender_input_tokens": 781, | ||||
| 119 | + "sender_output_tokens": 339, | ||||
| 120 | + "sender_prefill_ms": 290.4690830036998, | ||||
| 121 | + "sender_ttft_ms": 12.22833408974111, | ||||
| 122 | + "sender_decode_ms": 4067.22391594667 | ||||
| 123 | + }, | ||||
| 124 | + "repair": { | ||||
| 125 | + "lookups": 1, | ||||
| 126 | + "fetched_bytes": 602, | ||||
| 127 | + "codes_mentioned": 1 | ||||
| 128 | + }, | ||||
| 129 | + "ledger": { | ||||
| 130 | + "facts_total": 63, | ||||
| 131 | + "facts_retained": 12, | ||||
| 132 | + "retention_rate": 0.19047619047619047, | ||||
| 133 | + "retention_by_kind": { | ||||
| 134 | + "person": 0.16666666666666666, | ||||
| 135 | + "date": 0.25, | ||||
| 136 | + "amount": 0.07692307692307693, | ||||
| 137 | + "status": 0.5, | ||||
| 138 | + "place": 0.0, | ||||
| 139 | + "identifier": 0.08333333333333333, | ||||
| 140 | + "quantity": 0.16666666666666666 | ||||
| 141 | + }, | ||||
| 142 | + "unsupported_numbers": 0, | ||||
| 143 | + "unsupported_identifiers": 0, | ||||
| 144 | + "distorted_sentences": 0, | ||||
| 145 | + "message_bytes": 818 | ||||
| 146 | + } | ||||
| 147 | + }, | ||||
| 148 | + "5": { | ||||
| 149 | + "hop_ms": 4391.168999951333, | ||||
| 150 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 151 | + "usage": { | ||||
| 152 | + "sender_input_tokens": 781, | ||||
| 153 | + "sender_output_tokens": 339, | ||||
| 154 | + "sender_prefill_ms": 290.1889580534771, | ||||
| 155 | + "sender_ttft_ms": 12.174332980066538, | ||||
| 156 | + "sender_decode_ms": 4087.6918750582263 | ||||
| 157 | + }, | ||||
| 158 | + "repair": { | ||||
| 159 | + "lookups": 1, | ||||
| 160 | + "fetched_bytes": 602, | ||||
| 161 | + "codes_mentioned": 1 | ||||
| 162 | + }, | ||||
| 163 | + "ledger": { | ||||
| 164 | + "facts_total": 63, | ||||
| 165 | + "facts_retained": 12, | ||||
| 166 | + "retention_rate": 0.19047619047619047, | ||||
| 167 | + "retention_by_kind": { | ||||
| 168 | + "person": 0.16666666666666666, | ||||
| 169 | + "date": 0.25, | ||||
| 170 | + "amount": 0.07692307692307693, | ||||
| 171 | + "status": 0.5, | ||||
| 172 | + "place": 0.0, | ||||
| 173 | + "identifier": 0.08333333333333333, | ||||
| 174 | + "quantity": 0.16666666666666666 | ||||
| 175 | + }, | ||||
| 176 | + "unsupported_numbers": 0, | ||||
| 177 | + "unsupported_identifiers": 0, | ||||
| 178 | + "distorted_sentences": 0, | ||||
| 179 | + "message_bytes": 818 | ||||
| 180 | + } | ||||
| 181 | + }, | ||||
| 182 | + "6": { | ||||
| 183 | + "hop_ms": 4377.536708954722, | ||||
| 184 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 185 | + "usage": { | ||||
| 186 | + "sender_input_tokens": 781, | ||||
| 187 | + "sender_output_tokens": 339, | ||||
| 188 | + "sender_prefill_ms": 290.2912909630686, | ||||
| 189 | + "sender_ttft_ms": 12.157041928730905, | ||||
| 190 | + "sender_decode_ms": 4074.0044170524925 | ||||
| 191 | + }, | ||||
| 192 | + "repair": { | ||||
| 193 | + "lookups": 1, | ||||
| 194 | + "fetched_bytes": 602, | ||||
| 195 | + "codes_mentioned": 1 | ||||
| 196 | + }, | ||||
| 197 | + "ledger": { | ||||
| 198 | + "facts_total": 63, | ||||
| 199 | + "facts_retained": 12, | ||||
| 200 | + "retention_rate": 0.19047619047619047, | ||||
| 201 | + "retention_by_kind": { | ||||
| 202 | + "person": 0.16666666666666666, | ||||
| 203 | + "date": 0.25, | ||||
| 204 | + "amount": 0.07692307692307693, | ||||
| 205 | + "status": 0.5, | ||||
| 206 | + "place": 0.0, | ||||
| 207 | + "identifier": 0.08333333333333333, | ||||
| 208 | + "quantity": 0.16666666666666666 | ||||
| 209 | + }, | ||||
| 210 | + "unsupported_numbers": 0, | ||||
| 211 | + "unsupported_identifiers": 0, | ||||
| 212 | + "distorted_sentences": 0, | ||||
| 213 | + "message_bytes": 818 | ||||
| 214 | + } | ||||
| 215 | + }, | ||||
| 216 | + "7": { | ||||
| 217 | + "hop_ms": 4374.012624961324, | ||||
| 218 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 219 | + "usage": { | ||||
| 220 | + "sender_input_tokens": 781, | ||||
| 221 | + "sender_output_tokens": 339, | ||||
| 222 | + "sender_prefill_ms": 289.7126249736175, | ||||
| 223 | + "sender_ttft_ms": 12.297208071686327, | ||||
| 224 | + "sender_decode_ms": 4070.863875094801 | ||||
| 225 | + }, | ||||
| 226 | + "repair": { | ||||
| 227 | + "lookups": 1, | ||||
| 228 | + "fetched_bytes": 602, | ||||
| 229 | + "codes_mentioned": 1 | ||||
| 230 | + }, | ||||
| 231 | + "ledger": { | ||||
| 232 | + "facts_total": 63, | ||||
| 233 | + "facts_retained": 12, | ||||
| 234 | + "retention_rate": 0.19047619047619047, | ||||
| 235 | + "retention_by_kind": { | ||||
| 236 | + "person": 0.16666666666666666, | ||||
| 237 | + "date": 0.25, | ||||
| 238 | + "amount": 0.07692307692307693, | ||||
| 239 | + "status": 0.5, | ||||
| 240 | + "place": 0.0, | ||||
| 241 | + "identifier": 0.08333333333333333, | ||||
| 242 | + "quantity": 0.16666666666666666 | ||||
| 243 | + }, | ||||
| 244 | + "unsupported_numbers": 0, | ||||
| 245 | + "unsupported_identifiers": 0, | ||||
| 246 | + "distorted_sentences": 0, | ||||
| 247 | + "message_bytes": 818 | ||||
| 248 | + } | ||||
| 249 | + }, | ||||
| 250 | + "8": { | ||||
| 251 | + "hop_ms": 4377.300833002664, | ||||
| 252 | + "agent": "mlx-community/Qwen2.5-3B-Instruct-bf16", | ||||
| 253 | + "usage": { | ||||
| 254 | + "sender_input_tokens": 781, | ||||
| 255 | + "sender_output_tokens": 339, | ||||
| 256 | + "sender_prefill_ms": 290.2570000151172, | ||||
| 257 | + "sender_ttft_ms": 12.14954094029963, | ||||
| 258 | + "sender_decode_ms": 4073.769791983068 | ||||
| 259 | + }, | ||||
| 260 | + "repair": { | ||||
| 261 | + "lookups": 1, | ||||
| 262 | + "fetched_bytes": 602, | ||||
| 263 | + "codes_mentioned": 1 | ||||
| 264 | + }, | ||||
| 265 | + "ledger": { | ||||
| 266 | + "facts_total": 63, | ||||
| 267 | + "facts_retained": 12, | ||||
| 268 | + "retention_rate": 0.19047619047619047, | ||||
| 269 | + "retention_by_kind": { | ||||
| 270 | + "person": 0.16666666666666666, | ||||
| 271 | + "date": 0.25, | ||||
| 272 | + "amount": 0.07692307692307693, | ||||
| 273 | + "status": 0.5, | ||||
| 274 | + "place": 0.0, | ||||
| 275 | + "identifier": 0.08333333333333333, | ||||
| 276 | + "quantity": 0.16666666666666666 | ||||
| 277 | + }, | ||||
| 278 | + "unsupported_numbers": 0, | ||||
| 279 | + "unsupported_identifiers": 0, | ||||
| 280 | + "distorted_sentences": 0, | ||||
| 281 | + "message_bytes": 818 | ||||
| 282 | + } | ||||
| 283 | + } | ||||
| 284 | + } | ||||
| 285 | +} | ||||
| \ No newline at end of file | |||||
modified
runs/raw/remote/E4_core_shard0_m3u96b.jsonl
+975 −0
@@ -2623,3 +2623,978 @@ | |||||
| 2623 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b162f886218841a39399343c", "attempt_id": "e4e63600f593", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.169852Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 185.62729097902775, "ttft_ms": 11.925874976441264, "decode_ms": 47.405832912772894}, "total_wall_ms": 21964.225627016276, "ttft_ms": 11.925874976441264, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | 2623 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b162f886218841a39399343c", "attempt_id": "e4e63600f593", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.169852Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 185.62729097902775, "ttft_ms": 11.925874976441264, "decode_ms": 47.405832912772894}, "total_wall_ms": 21964.225627016276, "ttft_ms": 11.925874976441264, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||
| 2624 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb082e8097f0ee67f129a690", "attempt_id": "754476efbb71", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.429713Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 186.26170803327113, "ttft_ms": 11.866291984915733, "decode_ms": 11.894959025084972}, "total_wall_ms": 21929.25254406873, "ttft_ms": 11.866291984915733, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | 2624 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb082e8097f0ee67f129a690", "attempt_id": "754476efbb71", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.429713Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 186.26170803327113, "ttft_ms": 11.866291984915733, "decode_ms": 11.894959025084972}, "total_wall_ms": 21929.25254406873, "ttft_ms": 11.866291984915733, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||
| 2625 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89e13de313a27070f96961f5", "attempt_id": "1192f28acd67", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.655083Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 185.66583399660885, "ttft_ms": 11.722749914042652, "decode_ms": 11.803374974988401}, "total_wall_ms": 21928.473793086596, "ttft_ms": 11.722749914042652, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | 2625 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89e13de313a27070f96961f5", "attempt_id": "1192f28acd67", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:30.655083Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21718.831210047938, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683}, "receiver_prefill_ms": 185.66583399660885, "ttft_ms": 11.722749914042652, "decode_ms": 11.803374974988401}, "total_wall_ms": 21928.473793086596, "ttft_ms": 11.722749914042652, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||
| 2626 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1f7aa4ac28db426e9462c704", "attempt_id": "509f0586ceb4", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:50.591976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 460, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.69120892789215, "ttft_ms": 11.868500034324825, "decode_ms": 11.89162500668317}, "total_wall_ms": 41637.12862704415, "ttft_ms": 11.868500034324825, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2627 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "30827b67cd75275a944ecfa3", "attempt_id": "4b956dd8efe7", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:50.817498Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.96262496430427, "ttft_ms": 11.96454104501754, "decode_ms": 11.789167067036033}, "total_wall_ms": 41637.3655020725, "ttft_ms": 11.96454104501754, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2628 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bcf0fac8f19bd29a06f64021", "attempt_id": "9dabebf42c6a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.042525Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 184.82099997345358, "ttft_ms": 11.880457983352244, "decode_ms": 12.16229097917676}, "total_wall_ms": 41636.48425193969, "ttft_ms": 11.880457983352244, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2629 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cd80899899222e560f14c4e9", "attempt_id": "78a54017cc1b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.266420Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 463, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.6077500851825, "ttft_ms": 11.889124987646937, "decode_ms": 11.934250011108816}, "total_wall_ms": 41637.05754408147, "ttft_ms": 11.889124987646937, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2630 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83ec9388a20a29c81d9609ee", "attempt_id": "332b65d6084c", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.491055Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.66837499383837, "ttft_ms": 11.86079194303602, "decode_ms": 11.88775000628084}, "total_wall_ms": 41637.0368769858, "ttft_ms": 11.86079194303602, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2631 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "30ffe3b485f5c222e3deccb5", "attempt_id": "d32427a19537", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.715250Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.16775004193187, "ttft_ms": 11.90533407498151, "decode_ms": 11.867707944475114}, "total_wall_ms": 41637.58175203111, "ttft_ms": 11.90533407498151, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2632 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2f0b7943918e7a32b5613d88", "attempt_id": "5bcda0480d37", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:51.940219Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 461, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 184.79249998927116, "ttft_ms": 11.864167056046426, "decode_ms": 11.8454999756068}, "total_wall_ms": 41636.138335918076, "ttft_ms": 11.864167056046426, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2633 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "05ffc38086f0787c6e85c95a", "attempt_id": "486fe2b6e0e0", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.163716Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 462, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.69795798975974, "ttft_ms": 11.89908292144537, "decode_ms": 11.869458016008139}, "total_wall_ms": 41637.0997519698, "ttft_ms": 11.89908292144537, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2634 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5b795e637a0776a0efff044b", "attempt_id": "4d2df655a5d0", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.387894Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.6634590551257, "ttft_ms": 11.852583033032715, "decode_ms": 11.909167049452662}, "total_wall_ms": 41638.05362698622, "ttft_ms": 11.852583033032715, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2635 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5ea45deb13726ba60308bfec", "attempt_id": "5623b1124162", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.612954Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.8509590383619, "ttft_ms": 11.948750005103648, "decode_ms": 11.846582987345755}, "total_wall_ms": 41637.2786690481, "ttft_ms": 11.948750005103648, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2636 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7b937c223f4ac6fb25e9cf4", "attempt_id": "16b457b0913a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:52.837790Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.66258396115154, "ttft_ms": 11.848125024698675, "decode_ms": 59.24800003413111}, "total_wall_ms": 41685.39125204552, "ttft_ms": 11.848125024698675, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 2637 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "172399ef80b88f0477f16468", "attempt_id": "0e7ab39679a1", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.110680Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.79341599252075, "ttft_ms": 11.93629193585366, "decode_ms": 71.10645901411772}, "total_wall_ms": 41696.49600202683, "ttft_ms": 11.93629193585366, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "972465", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "0a00e59631ae965bf9ab3d3d1f18cb59d92aea878baa86f032ccec5b0696dce0"} | ||||
| 2638 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c0cde1360a80dd776b398901", "attempt_id": "35867cd3df7c", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.394481Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 185.3639589389786, "ttft_ms": 12.168999994173646, "decode_ms": 47.6904169190675}, "total_wall_ms": 41673.04825200699, "ttft_ms": 12.168999994173646, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 2639 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c4b0e4f592543159cb5475f6", "attempt_id": "6c18494121ad", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.655585Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.04341603349894, "ttft_ms": 12.104833964258432, "decode_ms": 12.137249927036464}, "total_wall_ms": 41638.14587704837, "ttft_ms": 12.104833964258432, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2640 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "185678dd0114cdb5fae5b0a9", "attempt_id": "267d568814ca", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:17:53.883722Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 41427.24412702955, "hops": {"1": 6925.180334015749, "2": 4936.230916995555, "3": 4929.1688749799505, "4": 4928.251084056683, "5": 4930.099040968344, "6": 4925.894750049338, "7": 4927.353916922584, "8": 4925.06520904135}, "receiver_prefill_ms": 186.3162920344621, "ttft_ms": 12.045166920870543, "decode_ms": 12.15504202991724}, "total_wall_ms": 41638.27246008441, "ttft_ms": 12.045166920870543, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2641 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "af0e42d0b1084fed64200fde", "attempt_id": "989677fd86d5", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:00.972787Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.402125088498, "ttft_ms": 12.21316703595221, "decode_ms": 11.887833010405302}, "total_wall_ms": 7111.151498975232, "ttft_ms": 12.21316703595221, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2642 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b2a09d16aff35ab7f9f40b15", "attempt_id": "db58afecd8ae", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:01.239208Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.97008401155472, "ttft_ms": 12.136540957726538, "decode_ms": 130.98520797211677}, "total_wall_ms": 7230.709374998696, "ttft_ms": 12.136540957726538, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 2643 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da421a27d683d923570a3bc2", "attempt_id": "14e935e8b50a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:01.624983Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.0039999857545, "ttft_ms": 11.921084020286798, "decode_ms": 83.41558300890028}, "total_wall_ms": 7183.151665958576, "ttft_ms": 11.921084020286798, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 2644 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "87baee15405fb7a62bff50d2", "attempt_id": "7d40e380956a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:01.962819Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.7918330617249, "ttft_ms": 12.025915901176631, "decode_ms": 47.71212500054389}, "total_wall_ms": 7147.156000020914, "ttft_ms": 12.025915901176631, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 2645 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e23c03ec72a3a634e13ecf7e", "attempt_id": "f97a4fc05b84", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:02.265293Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.13754198048264, "ttft_ms": 12.27516692597419, "decode_ms": 12.184666004031897}, "total_wall_ms": 7112.408332992345, "ttft_ms": 12.27516692597419, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2646 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a55f5f9c37ddc26b42971966", "attempt_id": "44e010c85d45", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:02.533199Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.2484590066597, "ttft_ms": 12.140959035605192, "decode_ms": 131.11216691322625}, "total_wall_ms": 7231.239791959524, "ttft_ms": 12.140959035605192, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 2647 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e0f9e0331ae77f1f3c4dcca6", "attempt_id": "16627c9a08a4", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:02.921271Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.95445804856718, "ttft_ms": 11.989000020548701, "decode_ms": 11.9677500333637}, "total_wall_ms": 7111.529208021238, "ttft_ms": 11.989000020548701, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2648 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eaf351a567901b5d636b7901", "attempt_id": "7c7a9334f070", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.188021Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.48525005206466, "ttft_ms": 12.032832950353622, "decode_ms": 11.912500020116568}, "total_wall_ms": 7111.016624025069, "ttft_ms": 12.032832950353622, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 2649 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "451cfecc9918407050534893", "attempt_id": "74f1140d4484", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.453727Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 229.28704204969108, "ttft_ms": 12.16325000859797, "decode_ms": 12.026750016957521}, "total_wall_ms": 7114.078290993348, "ttft_ms": 12.16325000859797, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2650 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "378adc8a667fa8fddede73d1", "attempt_id": "45697d980867", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.722608Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.62954207044095, "ttft_ms": 11.946208076551557, "decode_ms": 12.06508302129805}, "total_wall_ms": 7111.226874985732, "ttft_ms": 11.946208076551557, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2651 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bd5b8288eb43fbc74778ca88", "attempt_id": "fe63c1a2ee72", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:03.988549Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 609, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.37750003580004, "ttft_ms": 11.970457970164716, "decode_ms": 59.540791902691126}, "total_wall_ms": 7159.483207971789, "ttft_ms": 11.970457970164716, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 2652 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "693d6ee093db0ab9f80e4ef8", "attempt_id": "3467a640ac8a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:04.302529Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 227.26708301343024, "ttft_ms": 11.9785419665277, "decode_ms": 83.4002080373466}, "total_wall_ms": 7183.243583072908, "ttft_ms": 11.9785419665277, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1302481", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1c130ebf03e5051f031da47a49e8c91caae34e3c2144f451ec045a8e1c85549d"} | ||||
| 2653 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f1dec0bdc802d2531d269fdc", "attempt_id": "b6562f2ad885", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:04.640930Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.34291695430875, "ttft_ms": 12.062499998137355, "decode_ms": 11.937125003896654}, "total_wall_ms": 7111.109748948365, "ttft_ms": 12.062499998137355, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2654 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "225aa0bdffe8ab7c68a1bc2d", "attempt_id": "1284cd7b8c1e", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:04.906734Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.39533400069922, "ttft_ms": 12.255124980583787, "decode_ms": 11.995458044111729}, "total_wall_ms": 7111.378874978982, "ttft_ms": 12.255124980583787, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2655 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c4f55ba6563dde2e253a68fa", "attempt_id": "74385a148ddf", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:05.172487Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6860.111457994208, "hops": {"1": 6860.111457994208}, "receiver_prefill_ms": 226.69262497220188, "ttft_ms": 12.230082997120917, "decode_ms": 12.032125028781593}, "total_wall_ms": 7111.5701659582555, "ttft_ms": 12.230082997120917, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2656 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d62a89297f31d2f14e52f08a", "attempt_id": "ec06dd215e7b", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:11.742463Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 577, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 209.32583301328123, "ttft_ms": 11.933750007301569, "decode_ms": 11.934750014916062}, "total_wall_ms": 13395.379541092552, "ttft_ms": 11.933750007301569, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2657 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7d7b6fdd2cccadcb17bc0a68", "attempt_id": "b476270061c4", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:11.991795Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 227.2348329424858, "ttft_ms": 11.93300005979836, "decode_ms": 130.301000084728}, "total_wall_ms": 13531.631125020795, "ttft_ms": 11.93300005979836, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 2658 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1f38e6b02f18b205ce94701", "attempt_id": "15f50fe3a956", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:12.376929Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.3869169401005, "ttft_ms": 11.981499963440001, "decode_ms": 83.10983295086771}, "total_wall_ms": 13483.626958099194, "ttft_ms": 11.981499963440001, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 2659 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb03c0eeb92823b5de9ce689", "attempt_id": "e193f3d41d46", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:12.713802Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 580, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.5225830487907, "ttft_ms": 11.911417008377612, "decode_ms": 11.882040998898447}, "total_wall_ms": 13412.46295813471, "ttft_ms": 11.911417008377612, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2660 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d68ae32727b36042d2ee7c59", "attempt_id": "61f45f0a2116", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:12.979220Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 587, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.67000000365078, "ttft_ms": 12.13691697921604, "decode_ms": 11.901833000592887}, "total_wall_ms": 13412.861917051487, "ttft_ms": 12.13691697921604, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2661 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "569e7bf5a4ec8f5c44cabea3", "attempt_id": "4d36945963de", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:13.245674Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 588, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.48012498393655, "ttft_ms": 11.998458998277783, "decode_ms": 131.08833401929587}, "total_wall_ms": 13531.844624085352, "ttft_ms": 11.998458998277783, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 2662 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5439b7ea2f5d286c2f17ad45", "attempt_id": "7afd6978bee8", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:13.631115Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 578, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 225.67512502428144, "ttft_ms": 12.151958071626723, "decode_ms": 11.959291994571686}, "total_wall_ms": 13412.100958172232, "ttft_ms": 12.151958071626723, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2663 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ae060020ba2a575f6a79448", "attempt_id": "06ba95a72aba", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:13.896877Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 579, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 225.89400003198534, "ttft_ms": 12.093709083274007, "decode_ms": 11.991459061391652}, "total_wall_ms": 13412.250958150253, "ttft_ms": 12.093709083274007, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 2664 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "555fcc2c0601b06b6ea40726", "attempt_id": "c21c08f7425e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:14.163548Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.92554094828665, "ttft_ms": 11.92904100753367, "decode_ms": 11.978833004832268}, "total_wall_ms": 13412.984083057381, "ttft_ms": 11.92904100753367, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2665 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea6d7b1a40375117ca4a8985", "attempt_id": "dfd858c8d46d", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:14.430204Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 586, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.34762490633875, "ttft_ms": 11.899958946742117, "decode_ms": 11.99108303990215}, "total_wall_ms": 13412.35208301805, "ttft_ms": 11.899958946742117, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2666 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "777c33c64131b7f6665fa222", "attempt_id": "f9d9d7fa3a7f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:14.695586Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.97137494105846, "ttft_ms": 11.974541936069727, "decode_ms": 59.44470898248255}, "total_wall_ms": 13460.535542108119, "ttft_ms": 11.974541936069727, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 2667 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9808688b5da67796aa80fe81", "attempt_id": "1b41db8d342e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.009317Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.5684159938246, "ttft_ms": 11.967374943196774, "decode_ms": 94.82549992389977}, "total_wall_ms": 13495.493583148345, "ttft_ms": 11.967374943196774, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13024817", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "672c00df3bfd31225e9d03325d167c25800a9007589a430995bacbf8ad8c6f21"} | ||||
| 2668 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "40c70859f27d25f58330e92b", "attempt_id": "73c2aa411d76", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.358163Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 585, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.84412507805973, "ttft_ms": 11.883749975822866, "decode_ms": 11.935291928239167}, "total_wall_ms": 13412.811083020642, "ttft_ms": 11.883749975822866, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2669 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f47aaff34d48a1545ac238ec", "attempt_id": "ec1a0206b938", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.625521Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.9573329249397, "ttft_ms": 11.8819170165807, "decode_ms": 11.953916982747614}, "total_wall_ms": 13412.913375068456, "ttft_ms": 11.8819170165807, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2670 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16b41f5139a790c73426beec", "attempt_id": "e0c079376663", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:15.891792Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13161.659458070062, "hops": {"1": 6860.111457994208, "2": 6301.548000075854}, "receiver_prefill_ms": 226.9875839119777, "ttft_ms": 11.907708016224205, "decode_ms": 11.941958917304873}, "total_wall_ms": 13412.956041051075, "ttft_ms": 11.907708016224205, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2671 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "47dbca824955d1ae3187b5b2", "attempt_id": "4b33b63e5bab", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:28.732598Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 577, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 208.80850008688867, "ttft_ms": 11.889124987646937, "decode_ms": 11.852832976728678}, "total_wall_ms": 25966.977458214387, "ttft_ms": 11.889124987646937, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2672 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5fbbe72094418704b950ce2c", "attempt_id": "2d751a26a233", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:28.980959Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.34654201101512, "ttft_ms": 11.926042032428086, "decode_ms": 130.3043330553919}, "total_wall_ms": 26102.99900022801, "ttft_ms": 11.926042032428086, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 2673 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "636b1db17d7394fa10e4db7b", "attempt_id": "676086342928", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:29.365158Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.45491606090218, "ttft_ms": 12.106165988370776, "decode_ms": 82.95112499035895}, "total_wall_ms": 26055.92525016982, "ttft_ms": 12.106165988370776, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 2674 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9752381593d9c22229f9dad1", "attempt_id": "634285066f0d", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:29.701866Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 580, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.81824991013855, "ttft_ms": 12.0340830180794, "decode_ms": 11.84329204261303}, "total_wall_ms": 25985.095583135262, "ttft_ms": 12.0340830180794, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2675 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0376c88c828bef134fbed9da", "attempt_id": "a2d2f553b9cf", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:29.967992Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 587, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.58925002906471, "ttft_ms": 11.893625021912158, "decode_ms": 12.020291993394494}, "total_wall_ms": 25984.889708226547, "ttft_ms": 11.893625021912158, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2676 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f3a2ad21e7faa465c057bd52", "attempt_id": "56135811360c", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:30.233621Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 588, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.74441698472947, "ttft_ms": 11.915334034711123, "decode_ms": 130.16837497707456}, "total_wall_ms": 26103.23541611433, "ttft_ms": 11.915334034711123, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 2677 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a7e0415503bc1b18c154e71f", "attempt_id": "e2d867779f60", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:30.617805Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 578, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.10416694078594, "ttft_ms": 11.85033400543034, "decode_ms": 12.1004160027951}, "total_wall_ms": 25984.432583092712, "ttft_ms": 11.85033400543034, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2678 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "81cfa9d8f3ba1008aa6ebf45", "attempt_id": "2e2ab8e694c1", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:30.883044Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 579, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.06004192493856, "ttft_ms": 11.915459064766765, "decode_ms": 11.863666004501283}, "total_wall_ms": 25984.224875224754, "ttft_ms": 11.915459064766765, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 2679 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "798d6eab719c01d6fa323a5d", "attempt_id": "cde957380797", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.148078Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.8334999680519, "ttft_ms": 11.853165924549103, "decode_ms": 11.917417054064572}, "total_wall_ms": 25985.012792167254, "ttft_ms": 11.853165924549103, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2680 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6f56a31eb6966de70cf5c503", "attempt_id": "c3315cc70b5f", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.414421Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 586, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.39208403415978, "ttft_ms": 11.858208919875324, "decode_ms": 11.979374918155372}, "total_wall_ms": 25984.62350014597, "ttft_ms": 11.858208919875324, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2681 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "673baaca5ce68b663c4407c9", "attempt_id": "2d060ba1290a", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.680363Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.7625000094995, "ttft_ms": 11.84979104436934, "decode_ms": 59.57145907450467}, "total_wall_ms": 26032.5781252468, "ttft_ms": 11.84979104436934, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 2682 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bbd43850f5370d90b0173997", "attempt_id": "e3d42e35d164", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:31.993892Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.64541599806398, "ttft_ms": 11.909915949217975, "decode_ms": 95.06816603243351}, "total_wall_ms": 26068.139667157084, "ttft_ms": 11.909915949217975, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13024817", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "672c00df3bfd31225e9d03325d167c25800a9007589a430995bacbf8ad8c6f21"} | ||||
| 2683 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab4374f3eb03b45bd89473a7", "attempt_id": "701953fa6c1b", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:32.342938Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 585, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 225.72845791000873, "ttft_ms": 12.108584051020443, "decode_ms": 11.9452920043841}, "total_wall_ms": 25984.325875062495, "ttft_ms": 12.108584051020443, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2684 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "028d9e49e3548ba4b7b15965", "attempt_id": "12e58e6b60d0", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:32.608407Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.51729197241366, "ttft_ms": 11.971124913543463, "decode_ms": 12.001250055618584}, "total_wall_ms": 25984.878625255078, "ttft_ms": 11.971124913543463, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2685 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bb7fcd436e6930e9dc5471f4", "attempt_id": "6c8911670c59", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:32.874665Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 2238, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25733.930833172053, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966}, "receiver_prefill_ms": 226.58804105594754, "ttft_ms": 11.91033294890076, "decode_ms": 11.964667006395757}, "total_wall_ms": 25984.893624205142, "ttft_ms": 11.91033294890076, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2686 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e3fe79b117646c8676c65d0", "attempt_id": "fb80622b766e", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:58.272129Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 577, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 208.69258395396173, "ttft_ms": 11.884875013493001, "decode_ms": 11.874084011651576}, "total_wall_ms": 51093.529292033054, "ttft_ms": 11.884875013493001, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2687 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b99d21b2d0bfc02fbbefdcb8", "attempt_id": "a04ee8808f84", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:58.520777Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.50037507992238, "ttft_ms": 11.87854097224772, "decode_ms": 130.59416692703962}, "total_wall_ms": 51230.06037506275, "ttft_ms": 11.87854097224772, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 2688 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fdb50f2b66efd8c03eeebc15", "attempt_id": "f04eb326e10a", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:58.905448Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 583, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.56700003426522, "ttft_ms": 11.946541955694556, "decode_ms": 82.96749996952713}, "total_wall_ms": 51182.533667073585, "ttft_ms": 11.946541955694556, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 2689 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6d679d27a5f7afc5d3084456", "attempt_id": "4d333eabca8e", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:59.242133Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 580, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 225.9958341019228, "ttft_ms": 11.976291076280177, "decode_ms": 11.83108298573643}, "total_wall_ms": 51110.87299999781, "ttft_ms": 11.976291076280177, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2690 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c86d699770928bf84c3c791", "attempt_id": "ee4abff82877", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:59.507138Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 587, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.3192079262808, "ttft_ms": 12.070041964761913, "decode_ms": 11.930875014513731}, "total_wall_ms": 51111.36558302678, "ttft_ms": 12.070041964761913, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2691 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cfae9e6ec10ad8e3ded42592", "attempt_id": "121fceb1df67", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:59.772630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 588, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.77674994338304, "ttft_ms": 12.181833968497813, "decode_ms": 131.2990830047056}, "total_wall_ms": 51231.40708403662, "ttft_ms": 12.181833968497813, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 2692 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7996816ebde05369c712c59d", "attempt_id": "a68ad8d9efb1", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.158309Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 578, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 225.8157500764355, "ttft_ms": 11.92099996842444, "decode_ms": 11.865791981108487}, "total_wall_ms": 51110.675751115195, "ttft_ms": 11.92099996842444, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2693 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49a0c8f91f796305ff856c8b", "attempt_id": "d34aa3289eb0", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.423596Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 579, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.30445798859, "ttft_ms": 12.106165988370776, "decode_ms": 11.934584006667137}, "total_wall_ms": 51111.38970812317, "ttft_ms": 12.106165988370776, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 2694 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ea2c2bb519b47b7e2e55a3d", "attempt_id": "cfbf2567603c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.689159Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.98754200246185, "ttft_ms": 11.919333948753774, "decode_ms": 11.920499964617193}, "total_wall_ms": 51111.89204198308, "ttft_ms": 11.919333948753774, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2695 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0167a7006f01719d616eb409", "attempt_id": "f61a511130c5", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:00.955316Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 586, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.63349995855242, "ttft_ms": 11.85654103755951, "decode_ms": 11.883166967891157}, "total_wall_ms": 51111.41916702036, "ttft_ms": 11.85654103755951, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2696 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da4946f419698264580b92a1", "attempt_id": "7f552d794ce9", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:01.220838Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 227.0756249781698, "ttft_ms": 11.885665939189494, "decode_ms": 59.61816699709743}, "total_wall_ms": 51159.6483750036, "ttft_ms": 11.885665939189494, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 2697 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80ae66646370c00342102a8d", "attempt_id": "d18af4a3b85d", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:01.534430Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.76312504336238, "ttft_ms": 11.779709020629525, "decode_ms": 95.16625001560897}, "total_wall_ms": 51194.89991699811, "ttft_ms": 11.779709020629525, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13024817", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "672c00df3bfd31225e9d03325d167c25800a9007589a430995bacbf8ad8c6f21"} | ||||
| 2698 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b9af61640909b3879536487", "attempt_id": "6ada368df423", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:01.883642Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 585, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.4832080109045, "ttft_ms": 11.929625063203275, "decode_ms": 11.864207917824388}, "total_wall_ms": 51111.36079195421, "ttft_ms": 11.929625063203275, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2699 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e15e5250ce71ddcc2658ebf3", "attempt_id": "4cfacac919cb", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:02.150036Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 590, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.6715409932658, "ttft_ms": 11.828834074549377, "decode_ms": 11.788082891143858}, "total_wall_ms": 51111.34495900478, "ttft_ms": 11.828834074549377, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2700 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fa40e97d71123f2aa82a925c", "attempt_id": "cb55cfe2065c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:02.415622Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 497, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 5222, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50860.583542031236, "hops": {"1": 6860.111457994208, "2": 6301.548000075854, "3": 6284.723916091025, "4": 6287.547459010966, "5": 6284.2733329162, "6": 6280.639917007647, "7": 6281.036333995871, "8": 6280.703124939464}, "receiver_prefill_ms": 226.70029196888208, "ttft_ms": 12.28158304002136, "decode_ms": 12.00774998869747}, "total_wall_ms": 51112.22091712989, "ttft_ms": 12.28158304002136, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "3": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "4": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "5": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "6": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "7": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}, "8": {"facts_total": 65, "facts_retained": 36, "retention_rate": 0.5538461538461539, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.6, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1152}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "29d19ef4cb16ed19e33980db8a0baa06391ee0314866e83c8ddf69b297e56071", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2701 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7002b67bf9eb2768afd17adb", "attempt_id": "fe8d1440d3d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:09.542305Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 460, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 185.85645803250372, "ttft_ms": 11.812999960966408, "decode_ms": 11.776375002227724}, "total_wall_ms": 7068.241458036937, "ttft_ms": 11.812999960966408, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2702 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e66adc333f2567da560f1834", "attempt_id": "c06f66d4b144", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:09.768114Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.04087503626943, "ttft_ms": 11.82437501847744, "decode_ms": 11.819040984846652}, "total_wall_ms": 7068.433833075687, "ttft_ms": 11.82437501847744, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2703 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "056fe6d894d6b00f9a6e892f", "attempt_id": "1946bf0fb03a", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:09.993313Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.19808298535645, "ttft_ms": 11.798167019151151, "decode_ms": 12.033750070258975}, "total_wall_ms": 7068.761625094339, "ttft_ms": 11.798167019151151, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2704 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3db0368256e4ba413236b871", "attempt_id": "15451b002a81", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:10.218798Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 463, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.48212496191263, "ttft_ms": 11.84791699051857, "decode_ms": 11.852917028591037}, "total_wall_ms": 7068.891209084541, "ttft_ms": 11.84791699051857, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2705 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59aba285ef0deddc647f3aff", "attempt_id": "42307132b7d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:10.444118Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.20070908218622, "ttft_ms": 11.832916992716491, "decode_ms": 11.83708303142339}, "total_wall_ms": 7068.597042001784, "ttft_ms": 11.832916992716491, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2706 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "75f6d2adb964af62f2497c9f", "attempt_id": "daf9373e657b", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:10.669199Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.63504195865244, "ttft_ms": 11.767458054237068, "decode_ms": 117.8340419428423}, "total_wall_ms": 7174.971708096564, "ttft_ms": 11.767458054237068, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MH-96F-2099", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "95c230d14a055d30e0e1d4355caf07808e1c968b1feab9e0607d8bd37b1b43dc"} | ||||
| 2707 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3ff94bbdd1ac08e151c22d66", "attempt_id": "219a3b766dfe", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.000924Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 461, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.40212493482977, "ttft_ms": 11.827416019514203, "decode_ms": 11.863624909892678}, "total_wall_ms": 7068.831958109513, "ttft_ms": 11.827416019514203, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2708 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "018ba3cc8c9a8cee768e2a80", "attempt_id": "b32d7dec6bc5", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.226520Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 462, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.41974998172373, "ttft_ms": 11.842958047054708, "decode_ms": 11.901790974661708}, "total_wall_ms": 7068.881749990396, "ttft_ms": 11.842958047054708, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2709 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "277d6954f787cd5d446f40a6", "attempt_id": "c6f0c2be24bd", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.452007Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.70491699595004, "ttft_ms": 11.804500012658536, "decode_ms": 11.74224994610995}, "total_wall_ms": 7068.991417065263, "ttft_ms": 11.804500012658536, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2710 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b7f796434eadb85d1e52c8d", "attempt_id": "4d0a28b5c62d", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.677314Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 185.86433306336403, "ttft_ms": 11.796500068157911, "decode_ms": 82.50654197763652}, "total_wall_ms": 7138.8948750682175, "ttft_ms": 11.796500068157911, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | ||||
| 2711 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f2453af5a0ddc4ce71907a99", "attempt_id": "6955e20a5988", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:11.972728Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.30929209757596, "ttft_ms": 11.884625069797039, "decode_ms": 58.9661659905687}, "total_wall_ms": 7115.869125118479, "ttft_ms": 11.884625069797039, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 2712 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f836d7809ff3f93d6c0488a1", "attempt_id": "d2acd35d4fdb", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.244916Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.15483306348324, "ttft_ms": 11.910791974514723, "decode_ms": 82.62462494894862}, "total_wall_ms": 7139.431458082981, "ttft_ms": 11.910791974514723, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9484825", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "667b970507c4c6c7fb572757eb3b5eb04186ddb67a6ef680266b7a0924737993"} | ||||
| 2713 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7b5d98d0561e060d6ec4e5f7", "attempt_id": "30aedc46933a", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.541145Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 185.08358299732208, "ttft_ms": 11.85133308172226, "decode_ms": 47.42800001986325}, "total_wall_ms": 7103.088417090476, "ttft_ms": 11.85133308172226, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 2714 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f88746fbc36c8068ed7d1ffa", "attempt_id": "48a2686128e3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.800718Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.2459999974817, "ttft_ms": 11.850791983306408, "decode_ms": 11.878332938067615}, "total_wall_ms": 7068.681875127368, "ttft_ms": 11.850791983306408, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2715 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b5323b1dbad8832a4b42b95b", "attempt_id": "4d364c2e7123", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:13.025886Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6858.334750053473, "hops": {"1": 6858.334750053473}, "receiver_prefill_ms": 186.4105419954285, "ttft_ms": 11.826083064079285, "decode_ms": 11.851917020976543}, "total_wall_ms": 7068.8043751288205, "ttft_ms": 11.826083064079285, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2716 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e6cbc70328e25c8357cf35b", "attempt_id": "256aa5c2e015", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.228976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.03099999018013, "ttft_ms": 11.82962500024587, "decode_ms": 11.953708017244935}, "total_wall_ms": 12045.24783405941, "ttft_ms": 11.82962500024587, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2717 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7d2c180a1c7770a34353ebea", "attempt_id": "1b45fcde11d4", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.455315Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 185.98220800049603, "ttft_ms": 11.92508393432945, "decode_ms": 11.82125008199364}, "total_wall_ms": 12045.16641702503, "ttft_ms": 11.92508393432945, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2718 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4065a27e12390281dc1a284d", "attempt_id": "8d1669b73dd2", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.680748Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.37154099997133, "ttft_ms": 11.898875003680587, "decode_ms": 11.90529193263501}, "total_wall_ms": 12045.558709069155, "ttft_ms": 11.898875003680587, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2719 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c1aaf0deef0986db8d193e60", "attempt_id": "3cd5be4201c1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.906734Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 472, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.2717499025166, "ttft_ms": 11.856916011311114, "decode_ms": 11.921083088964224}, "total_wall_ms": 12045.455584069714, "ttft_ms": 11.856916011311114, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2720 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "252e4c859c4a0d299f7534e9", "attempt_id": "6deedad5e522", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.131823Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 479, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.42104207538068, "ttft_ms": 11.926540988497436, "decode_ms": 11.951540946029127}, "total_wall_ms": 12045.738041982986, "ttft_ms": 11.926540988497436, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2721 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a21420be37a7f74a720ff260", "attempt_id": "f5dca43f25c8", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.357510Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 480, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.9509998941794, "ttft_ms": 11.850583949126303, "decode_ms": 11.91483298316598}, "total_wall_ms": 12046.148416935466, "ttft_ms": 11.850583949126303, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2722 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "94c80fa0c3585f8f9a6a4371", "attempt_id": "06c04ad86cff", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.583359Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 185.8234580140561, "ttft_ms": 11.889416025951505, "decode_ms": 11.819042032584548}, "total_wall_ms": 12044.914458063431, "ttft_ms": 11.889416025951505, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2723 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "13920be4e8b3077047f4bcb1", "attempt_id": "ca2e4b7fb25e", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:19.808278Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 185.40650000795722, "ttft_ms": 11.837625061161816, "decode_ms": 12.097875005565584}, "total_wall_ms": 12044.712999952026, "ttft_ms": 11.837625061161816, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2724 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f1e1bde8d469b9511959f7dd", "attempt_id": "3b5ca0e31235", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.032809Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 487, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 187.7643340267241, "ttft_ms": 12.007332989014685, "decode_ms": 11.868707952089608}, "total_wall_ms": 12047.183291986585, "ttft_ms": 12.007332989014685, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2725 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "626fc8db67d1025bfd518da4", "attempt_id": "185429d9d04f", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.259865Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.68425001669675, "ttft_ms": 12.029709061607718, "decode_ms": 11.898832977749407}, "total_wall_ms": 12046.112125040963, "ttft_ms": 12.029709061607718, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2726 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fd4d061eb9a4a8b88d58adca", "attempt_id": "4381706f570f", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.487599Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 486, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 188.31787491217256, "ttft_ms": 11.744957999326289, "decode_ms": 59.13312500342727}, "total_wall_ms": 12094.612958026119, "ttft_ms": 11.744957999326289, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 2727 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bcbac3d81b7e97b6b137539c", "attempt_id": "aba4e720a3a9", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.762724Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 184.85312501434237, "ttft_ms": 11.861666920594871, "decode_ms": 71.2572910124436}, "total_wall_ms": 12103.36525097955, "ttft_ms": 11.861666920594871, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "948485", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "244f716d260fa5f07cbedd5d728983a25a4991af5624be73b358ad829974e9c4"} | ||||
| 2728 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f3de17234aeea84dd5b95577", "attempt_id": "c15b8c38d8ec", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.046208Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 186.66945898439735, "ttft_ms": 11.865791049785912, "decode_ms": 47.31558298226446}, "total_wall_ms": 12081.220626016147, "ttft_ms": 11.865791049785912, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 2729 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a81ec4ec9bd3a601e58289fe", "attempt_id": "40dbfa1c2926", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.307238Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 183.93512489274144, "ttft_ms": 11.840457911603153, "decode_ms": 11.890291003510356}, "total_wall_ms": 12043.01712603774, "ttft_ms": 11.840457911603153, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2730 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b069866f2a9d4a0469f8926e", "attempt_id": "d95444748c58", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.529885Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 484, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 497, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11834.982667001896, "hops": {"1": 6858.334750053473, "2": 4976.647916948423}, "receiver_prefill_ms": 184.3267499934882, "ttft_ms": 12.121375068090856, "decode_ms": 11.842624982818961}, "total_wall_ms": 12043.780250940472, "ttft_ms": 12.121375068090856, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2731 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dfa2aa0a6797ae01ac3bb479", "attempt_id": "2e5c39521ba7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:31.702812Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 185.75866695027798, "ttft_ms": 11.88416697550565, "decode_ms": 11.851958930492401}, "total_wall_ms": 21991.85891705565, "ttft_ms": 11.88416697550565, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2732 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "15a75188a5ffb34386213b74", "attempt_id": "73a93a1758d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:31.928435Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 185.9312909655273, "ttft_ms": 11.89075002912432, "decode_ms": 11.830749921500683}, "total_wall_ms": 21992.001833976246, "ttft_ms": 11.89075002912432, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2733 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eba8144f5bd7dde0d3a2d64c", "attempt_id": "a941fdee95e0", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.153994Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.0080419573933, "ttft_ms": 11.859874939545989, "decode_ms": 11.83879200834781}, "total_wall_ms": 21992.018583929166, "ttft_ms": 11.859874939545989, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2734 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f724d68fa8bcbe7d6e1577d2", "attempt_id": "4f84aeec5f94", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.378976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 472, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 185.7952909776941, "ttft_ms": 11.80870900861919, "decode_ms": 11.859916034154594}, "total_wall_ms": 21991.88129301183, "ttft_ms": 11.80870900861919, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2735 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36a85823539f6a10202e88a7", "attempt_id": "127c2829dc22", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.603630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 479, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.8701659841463, "ttft_ms": 12.091000098735094, "decode_ms": 12.0086669921875}, "total_wall_ms": 21993.4917089995, "ttft_ms": 12.091000098735094, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2736 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "37830f8f492bf43790a4f5cd", "attempt_id": "b5793ea260aa", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:32.830677Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 480, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.83437502477318, "ttft_ms": 11.896374984644353, "decode_ms": 118.63562499638647}, "total_wall_ms": 22099.718958954327, "ttft_ms": 11.896374984644353, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MH-96F-2099", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "95c230d14a055d30e0e1d4355caf07808e1c968b1feab9e0607d8bd37b1b43dc"} | ||||
| 2737 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b4a1c5c1a5cb96858488e5c", "attempt_id": "083ea0124ec7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.163667Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.04454200249165, "ttft_ms": 12.004374992102385, "decode_ms": 12.01070798560977}, "total_wall_ms": 21992.376458947547, "ttft_ms": 12.004374992102385, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2738 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "382141b8893e0a3ed2316441", "attempt_id": "050db41f693c", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.388935Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.2477499525994, "ttft_ms": 11.954624904319644, "decode_ms": 11.891416972503066}, "total_wall_ms": 21992.477542953566, "ttft_ms": 11.954624904319644, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2739 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "29696173109d11f819ab2338", "attempt_id": "b43101214d10", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.614253Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 487, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 188.15254094079137, "ttft_ms": 11.985791963525116, "decode_ms": 11.900500045157969}, "total_wall_ms": 21994.395583984442, "ttft_ms": 11.985791963525116, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2740 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5ad9569a760a8b4a55e2f797", "attempt_id": "66a285a6515c", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.842033Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.2962500890717, "ttft_ms": 11.930083041079342, "decode_ms": 82.44408294558525}, "total_wall_ms": 22063.01591708325, "ttft_ms": 11.930083041079342, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | ||||
| 2741 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "028a9e0044c5d46d286f6fed", "attempt_id": "60c5a1ca23d5", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.138017Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 486, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 187.87783302832395, "ttft_ms": 12.163541978225112, "decode_ms": 59.53324993606657}, "total_wall_ms": 22042.043125955388, "ttft_ms": 12.163541978225112, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 2742 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "527e2d10941436d9843e61a1", "attempt_id": "c592b95a8f96", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.413111Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 183.64629102870822, "ttft_ms": 12.180499965324998, "decode_ms": 71.41625008080155}, "total_wall_ms": 22049.708334030584, "ttft_ms": 12.180499965324998, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "948485", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "244f716d260fa5f07cbedd5d728983a25a4991af5624be73b358ad829974e9c4"} | ||||
| 2743 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aeae98ccabe2505393002aa1", "attempt_id": "766c03efe5d0", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.696891Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 186.47487496491522, "ttft_ms": 11.89762493595481, "decode_ms": 47.2524999640882}, "total_wall_ms": 22027.974458993413, "ttft_ms": 11.89762493595481, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 2744 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c41f0753cb706d74e42b6b3", "attempt_id": "c4ac4a286d9f", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:34.958329Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 184.58412494510412, "ttft_ms": 11.8815409950912, "decode_ms": 11.83712505735457}, "total_wall_ms": 21990.61270907987, "ttft_ms": 11.8815409950912, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2745 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8d38122e717d899535c9eb40", "attempt_id": "38249278f441", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:35.181575Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 484, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 1491, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21781.92445903551, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824}, "receiver_prefill_ms": 184.33633400127292, "ttft_ms": 12.082625064067543, "decode_ms": 11.769582983106375}, "total_wall_ms": 21990.528916940093, "ttft_ms": 12.082625064067543, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2746 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a5e8c30bfca2b101baa1e68", "attempt_id": "b78523874eab", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:28.022760Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 340.0229170219973, "ttft_ms": 45.39320897310972, "decode_ms": 45.83379102405161}, "total_wall_ms": 74826.11566700507, "ttft_ms": 45.39320897310972, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2747 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a683658fa9392dd17ce6440", "attempt_id": "eb547cf2883a", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:28.472013Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 352.55520802456886, "ttft_ms": 40.868874988518655, "decode_ms": 49.819333013147116}, "total_wall_ms": 74838.15391699318, "ttft_ms": 40.868874988518655, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2748 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8fb2dac235b6f6ce7584c34b", "attempt_id": "d2685afb6944", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:28.932361Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 349.36150000430644, "ttft_ms": 45.4847919754684, "decode_ms": 45.87041598279029}, "total_wall_ms": 74835.56275104638, "ttft_ms": 45.4847919754684, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2749 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a9f593f2ff39fcf69b942f42", "attempt_id": "6d7e7ec41a6c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:29.390259Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 472, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 347.4786669248715, "ttft_ms": 43.20362501312047, "decode_ms": 43.96199993789196}, "total_wall_ms": 74829.48395900894, "ttft_ms": 43.20362501312047, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2750 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad0f49cc3de245521249fc25", "attempt_id": "21cfa4f1a7f0", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:29.841743Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 479, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 352.6987920049578, "ttft_ms": 43.187833041884005, "decode_ms": 42.309709009714425}, "total_wall_ms": 74833.044292056, "ttft_ms": 43.187833041884005, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2751 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3502e86bf97404a55715cc00", "attempt_id": "e0d344a6d861", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:30.297083Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 480, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 345.83670797292143, "ttft_ms": 42.64020803384483, "decode_ms": 44.390999944880605}, "total_wall_ms": 74827.73033308331, "ttft_ms": 42.64020803384483, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2752 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ac43d333871d75b68cd3c0e", "attempt_id": "9fa8def0c378", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:30.747369Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 352.1522500086576, "ttft_ms": 42.748916894197464, "decode_ms": 43.836083030328155}, "total_wall_ms": 74833.56412500143, "ttft_ms": 42.748916894197464, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2753 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0bd0d9236e7e6858679ebca3", "attempt_id": "df60b3a28f0c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:31.203193Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 348.0954170227051, "ttft_ms": 43.39912498835474, "decode_ms": 45.071667060256004}, "total_wall_ms": 74831.42375107855, "ttft_ms": 43.39912498835474, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2754 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f90358cc02c8683295d680bb", "attempt_id": "78ca28800c77", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:31.656557Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 487, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 343.14599994104356, "ttft_ms": 43.34687499795109, "decode_ms": 44.94879103731364}, "total_wall_ms": 74826.35062502231, "ttft_ms": 43.34687499795109, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2755 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc9ce330ccf4853dfb3dcb38", "attempt_id": "f825c6f6578c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:32.105447Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 345.6582920625806, "ttft_ms": 47.286625020205975, "decode_ms": 47.979500028304756}, "total_wall_ms": 74835.76629206073, "ttft_ms": 47.286625020205975, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2756 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a41acb50667e7f864294bac0", "attempt_id": "c11804a977a9", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:32.563433Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 486, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 349.50512496288866, "ttft_ms": 43.788625043816864, "decode_ms": 230.5075420299545}, "total_wall_ms": 75018.74208403751, "ttft_ms": 43.788625043816864, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 2757 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f41941a5d8bcebe43141d429", "attempt_id": "4628dc9ce16e", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:33.204580Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 322.29170901700854, "ttft_ms": 41.97966691572219, "decode_ms": 336.1370420316234}, "total_wall_ms": 75095.3966670204, "ttft_ms": 41.97966691572219, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9484825", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "667b970507c4c6c7fb572757eb3b5eb04186ddb67a6ef680266b7a0924737993"} | ||||
| 2758 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7e420a79e238512cb1897a09", "attempt_id": "4dffb167c771", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:33.922899Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 334.5014579826966, "ttft_ms": 43.67445793468505, "decode_ms": 177.05166607629508}, "total_wall_ms": 74950.17541700508, "ttft_ms": 43.67445793468505, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 2759 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "14202cc2f32a4176dd106b01", "attempt_id": "b035e5911950", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:34.496099Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 482, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 287.6303750090301, "ttft_ms": 50.758292083628476, "decode_ms": 45.91450002044439}, "total_wall_ms": 74779.32237612549, "ttft_ms": 50.758292083628476, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2760 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fd33d63090bdafcef3f49ccf", "attempt_id": "eed2993c9598", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:34.898102Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 484, "message_tokens": 389, "message_utf8_bytes": 931, "cache_tensor_bytes": null, "serialized_payload_bytes": 931, "side_information_bytes": 0, "fetched_bytes": 3479, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 74394.34491703287, "hops": {"1": 6858.334750053473, "2": 4976.647916948423, "3": 4970.926292007789, "4": 4976.015500025824, "5": 4970.625541987829, "6": 7763.661833014339, "7": 19990.075874957256, "8": 19888.057208037935}, "receiver_prefill_ms": 312.707083998248, "ttft_ms": 66.90520804841071, "decode_ms": 30.21133306901902}, "total_wall_ms": 74804.78116706945, "ttft_ms": 66.90520804841071, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 867}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "92d15207bf13f35ba83fc20f1408c2fcf07fd4b0ed40fc18f51a5580586b6137", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2761 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3f32aff76e950cc1f431ac0b", "attempt_id": "18e8a15f2269", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:57.689777Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.15991700533777, "ttft_ms": 11.977292015217245, "decode_ms": 12.12245796341449}, "total_wall_ms": 22613.57029201463, "ttft_ms": 11.977292015217245, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2762 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ccce6a133688b4134eca730", "attempt_id": "69d1ebce5c5d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:57.958203Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.10354207083583, "ttft_ms": 11.963792028836906, "decode_ms": 130.18362503498793}, "total_wall_ms": 22731.602748972364, "ttft_ms": 11.963792028836906, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 2763 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "69fd52a6e9e971b5b0f1a5be", "attempt_id": "c3cd2d356187", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:58.344277Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.86120797879994, "ttft_ms": 12.056584004312754, "decode_ms": 83.35712493862957}, "total_wall_ms": 22684.603373985738, "ttft_ms": 12.056584004312754, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 2764 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "086a7f165c3fbc3ff0a9a94d", "attempt_id": "8fe5df06bc82", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:58.683917Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.997458958067, "ttft_ms": 11.92891609389335, "decode_ms": 47.57245793007314}, "total_wall_ms": 22648.729874985293, "ttft_ms": 11.92891609389335, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 2765 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3b07f98b72002e5a2beb5675", "attempt_id": "480b6b5c4b68", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:58.987077Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.1020410116762, "ttft_ms": 11.852875002659857, "decode_ms": 11.78449997678399}, "total_wall_ms": 22612.94329096563, "ttft_ms": 11.852875002659857, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2766 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a70ed564ccfaa4f69e25a5db", "attempt_id": "180361820b0d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:59.253998Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.24337503314018, "ttft_ms": 12.091082986444235, "decode_ms": 130.82462491001934}, "total_wall_ms": 22732.50016605016, "ttft_ms": 12.091082986444235, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 2767 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55ab9256a03c14bb7dd4931b", "attempt_id": "ef477ebc6624", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:59.640788Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.3879170641303, "ttft_ms": 12.00712495483458, "decode_ms": 11.904167011380196}, "total_wall_ms": 22612.498832982965, "ttft_ms": 12.00712495483458, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2768 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7abf703b61fcd40e55e50017", "attempt_id": "8c998977055d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:59.907437Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.28329205326736, "ttft_ms": 12.032249942421913, "decode_ms": 11.911874986253679}, "total_wall_ms": 22612.483248929493, "ttft_ms": 12.032249942421913, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 2769 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d65af73e32722271da5a697f", "attempt_id": "69e2265cd084", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.173848Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 228.54887507855892, "ttft_ms": 12.094540987163782, "decode_ms": 11.97579107247293}, "total_wall_ms": 22614.94124995079, "ttft_ms": 12.094540987163782, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2770 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b77b378869a751190db2006", "attempt_id": "dc6e82d8f82f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.442933Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.77829093299806, "ttft_ms": 11.983916047029197, "decode_ms": 11.876125005073845}, "total_wall_ms": 22612.849042052403, "ttft_ms": 11.983916047029197, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2771 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e648daf57fc4b7499c862983", "attempt_id": "8933bb3596ed", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.709933Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 609, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.77929198835045, "ttft_ms": 11.996500077657402, "decode_ms": 59.55533299129456}, "total_wall_ms": 22660.552707966417, "ttft_ms": 11.996500077657402, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 2772 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36038c95f552b868a77e602c", "attempt_id": "ed6f2fe9ce1e", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.024375Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 226.84737492818385, "ttft_ms": 11.92341698333621, "decode_ms": 83.45675002783537}, "total_wall_ms": 22684.485999983735, "ttft_ms": 11.92341698333621, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1302481", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "1c130ebf03e5051f031da47a49e8c91caae34e3c2144f451ec045a8e1c85549d"} | ||||
| 2773 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "492c0d6f11ac682eb4512d80", "attempt_id": "1fafdc280733", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.362678Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.03187505248934, "ttft_ms": 11.922708945348859, "decode_ms": 11.946249986067414}, "total_wall_ms": 22613.093541003764, "ttft_ms": 11.922708945348859, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2774 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2df4dd884149fe98087de143", "attempt_id": "2afa5408fb88", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.630041Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.51516697462648, "ttft_ms": 12.134875054471195, "decode_ms": 11.938791954889894}, "total_wall_ms": 22613.76391700469, "ttft_ms": 12.134875054471195, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2775 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c686aa3b751a76688e4f0425", "attempt_id": "2f78f3dc67fc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.897387Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1179, "cache_tensor_bytes": null, "serialized_payload_bytes": 1179, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22361.685457988642, "hops": {"1": 22361.685457988642}, "receiver_prefill_ms": 227.29337494820356, "ttft_ms": 12.00641703326255, "decode_ms": 11.979499948211014}, "total_wall_ms": 22613.481333013624, "ttft_ms": 12.00641703326255, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f6342dcd02ebd80508f967d8bfed98ca4bc1afeea750629dadac4b492752e270", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2776 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f862c2ccc6a03ef548071aab", "attempt_id": "045bce2d6652", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:07.294655Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 523, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.22116695530713, "ttft_ms": 11.660957941785455, "decode_ms": 11.498666950501502}, "total_wall_ms": 27724.15650007315, "ttft_ms": 11.660957941785455, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2777 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "db12f48a9bbcdbd11e580978", "attempt_id": "4d033e5560f0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:07.544880Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 529, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 209.99633392784745, "ttft_ms": 11.670165928080678, "decode_ms": 115.16645806841552}, "total_wall_ms": 27827.570000081323, "ttft_ms": 11.670165928080678, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "d34fb8d4553d115f1c915ac9be75f68ef887916efddf5ed339f7cf4236ce8fa8"} | ||||
| 2778 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "20467eed2b5a943e1a5f0fa7", "attempt_id": "4d1c73b5afe8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:07.898088Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 529, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.57508408557624, "ttft_ms": 11.598790995776653, "decode_ms": 45.95241602510214}, "total_wall_ms": 27758.832333027385, "ttft_ms": 11.598790995776653, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 2779 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "763d60481be4b5a97d68cdf6", "attempt_id": "9929b23e05b4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.182280Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 526, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.09791700635105, "ttft_ms": 11.771790916100144, "decode_ms": 57.52425000537187}, "total_wall_ms": 27770.269833039492, "ttft_ms": 11.771790916100144, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "4b9af6bc1085ca0df8d10d93274bfa44fbaf913b3380b2525ac5097c55375881"} | ||||
| 2780 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03a50238aa5cbe37b7e41a6b", "attempt_id": "0db3937a6c23", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.477645Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 533, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.60975000727922, "ttft_ms": 11.655749985948205, "decode_ms": 11.569624999538064}, "total_wall_ms": 27724.703874089755, "ttft_ms": 11.655749985948205, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2781 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "43c03f1b00667b18510f48ab", "attempt_id": "eb438b0eca2a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.728978Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 532, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.614874958992, "ttft_ms": 11.602125014178455, "decode_ms": 92.22799993585795}, "total_wall_ms": 27805.317124002613, "ttft_ms": 11.602125014178455, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 2782 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c675939ad6211efbb6373c30", "attempt_id": "92017bd50999", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.060414Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 524, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 209.64662497863173, "ttft_ms": 11.932790977880359, "decode_ms": 23.21420900989324}, "total_wall_ms": 27735.703124082647, "ttft_ms": 11.932790977880359, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2783 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83fbc27fe5935e587845e2bb", "attempt_id": "72dfab763b07", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.321282Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 525, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.05875000264496, "ttft_ms": 11.809790972620249, "decode_ms": 23.053209064528346}, "total_wall_ms": 27735.625999979675, "ttft_ms": 11.809790972620249, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 2784 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad46b8a8e7e6aac75a20b736", "attempt_id": "67cbc96658cc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.583398Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 541, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.89633298106492, "ttft_ms": 11.642707977443933, "decode_ms": 11.571875074878335}, "total_wall_ms": 27724.89658300765, "ttft_ms": 11.642707977443933, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2785 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c05955bfb683065921a22812", "attempt_id": "1e21de775118", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.833444Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 532, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.49687499180436, "ttft_ms": 11.573707917705178, "decode_ms": 11.591500020585954}, "total_wall_ms": 27724.35154102277, "ttft_ms": 11.573707917705178, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2786 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9b4347ff7944f073058090bf", "attempt_id": "be92416beb33", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:10.083222Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 540, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.98874998278916, "ttft_ms": 11.540542007423937, "decode_ms": 11.573166935704648}, "total_wall_ms": 27724.788957973942, "ttft_ms": 11.540542007423937, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2787 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c3923e64928b533ab815197f", "attempt_id": "974a25d8a3b2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:10.332740Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 536, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.7438329840079, "ttft_ms": 11.577583965845406, "decode_ms": 219.00204208213836}, "total_wall_ms": 27932.060915976763, "ttft_ms": 11.577583965845406, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,862,425 + 5,646,720 = 10,509,145", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "038d9ed23c4639e6ae998b25ae021dada1e0ab0526113d0a0e4d8884ea4b4e6f"} | ||||
| 2788 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b8340747be15e7671266d69d", "attempt_id": "74b2ac82de5f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:10.789438Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 531, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.57391597423702, "ttft_ms": 11.641624965704978, "decode_ms": 11.491750017739832}, "total_wall_ms": 27724.412208073772, "ttft_ms": 11.641624965704978, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2789 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "54a7b3e6aea0779e89e63106", "attempt_id": "6291ce6a3a2a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:11.038833Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 535, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.2422920288518, "ttft_ms": 11.586208012886345, "decode_ms": 11.50383404456079}, "total_wall_ms": 27724.0187501302, "ttft_ms": 11.586208012886345, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2790 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50a80ab68c959295f0b3f3d5", "attempt_id": "15b0346e5d8c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:11.287613Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 538, "message_tokens": 421, "message_utf8_bytes": 1181, "cache_tensor_bytes": null, "serialized_payload_bytes": 1181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27490.246208035387, "hops": {"1": 22361.685457988642, "2": 5128.560750046745}, "receiver_prefill_ms": 210.84425004664809, "ttft_ms": 11.568416957743466, "decode_ms": 11.542583000846207}, "total_wall_ms": 27724.645416019484, "ttft_ms": 11.568416957743466, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "8669fc537fe26ddfe1b74689f872379bdcad840ad09064ca93b4d5535b301a41", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2791 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8f8e838994a5174ead46b7d5", "attempt_id": "8cf5d1f0b1e4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:21.918304Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 487, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.54650002345443, "ttft_ms": 11.57233293633908, "decode_ms": 11.76929206121713}, "total_wall_ms": 38100.84308194928, "ttft_ms": 11.57233293633908, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2792 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2db0d38245b2405e048a54e0", "attempt_id": "70b698c53a4f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:22.166273Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 493, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 209.6134580206126, "ttft_ms": 11.551541974768043, "decode_ms": 115.2444159379229}, "total_wall_ms": 38206.339915981516, "ttft_ms": 11.551541974768043, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "d34fb8d4553d115f1c915ac9be75f68ef887916efddf5ed339f7cf4236ce8fa8"} | ||||
| 2793 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c274063c0b31713f29296ab0", "attempt_id": "ff432b7730f3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:22.518638Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 493, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.88049995806068, "ttft_ms": 11.547166970558465, "decode_ms": 45.98920908756554}, "total_wall_ms": 38134.30274894927, "ttft_ms": 11.547166970558465, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 2794 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "08abe6ac6fa2a1af4a65fef3", "attempt_id": "5d5f05aef9e0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:22.798662Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 490, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 205.76804096344858, "ttft_ms": 11.562332976609468, "decode_ms": 45.92741699889302}, "total_wall_ms": 38133.16487404518, "ttft_ms": 11.562332976609468, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 2795 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "79e4060b1f6f6b4884b63681", "attempt_id": "172508a55104", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.077990Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 497, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 208.45854096114635, "ttft_ms": 11.590208043344319, "decode_ms": 11.560541926883161}, "total_wall_ms": 38101.5318329446, "ttft_ms": 11.590208043344319, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2796 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a562deb1d153141db63bc3ae", "attempt_id": "c81fbe85b986", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.325117Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 496, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.76049990672618, "ttft_ms": 11.609584093093872, "decode_ms": 91.86570800375193}, "total_wall_ms": 38181.12691491842, "ttft_ms": 11.609584093093872, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 2797 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3fbff6745fe8870007f76375", "attempt_id": "a444b81acc61", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.652075Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 488, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 205.86283307056874, "ttft_ms": 11.583667015656829, "decode_ms": 23.060834035277367}, "total_wall_ms": 38110.413582995534, "ttft_ms": 11.583667015656829, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2798 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e3cec7c9b0ec4868d6642da", "attempt_id": "2f59ef09a633", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:23.908264Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 489, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 204.29266605060548, "ttft_ms": 11.598250013776124, "decode_ms": 23.074583965353668}, "total_wall_ms": 38108.83570695296, "ttft_ms": 11.598250013776124, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 2799 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3d866a4a0d91dc939570e711", "attempt_id": "186e9400ec55", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.162872Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 505, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.75370893534273, "ttft_ms": 11.625792016275227, "decode_ms": 11.582374921999872}, "total_wall_ms": 38100.87904101238, "ttft_ms": 11.625792016275227, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2800 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc7b085d691e3ff4e3a0e760", "attempt_id": "757bc48ff199", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.409225Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 496, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 203.9944170974195, "ttft_ms": 11.524083907715976, "decode_ms": 11.50795805733651}, "total_wall_ms": 38096.91137401387, "ttft_ms": 11.524083907715976, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2801 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b2c19d6fc08f28efbe8c682", "attempt_id": "f4f7ab28d7a2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.652131Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 504, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.81166602298617, "ttft_ms": 11.575083015486598, "decode_ms": 11.601999984122813}, "total_wall_ms": 38099.86699896399, "ttft_ms": 11.575083015486598, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2802 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3a1f23850d4f95f7b6b6870c", "attempt_id": "99402b636d75", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.897630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 500, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.85012498870492, "ttft_ms": 11.604624916799366, "decode_ms": 219.0847919555381}, "total_wall_ms": 38307.52749904059, "ttft_ms": 11.604624916799366, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,862,425 + 5,646,720 = 10,509,145", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "038d9ed23c4639e6ae998b25ae021dada1e0ab0526113d0a0e4d8884ea4b4e6f"} | ||||
| 2803 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "87302980abc81826c43804e4", "attempt_id": "e37a2124be1c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:25.350792Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 495, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.85816700663418, "ttft_ms": 11.542499996721745, "decode_ms": 11.541875079274178}, "total_wall_ms": 38100.84054002073, "ttft_ms": 11.542499996721745, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2804 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9d9fda703c1bf5aac43ed159", "attempt_id": "dda852f30875", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:25.597921Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 499, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 206.54475002083927, "ttft_ms": 11.62362506147474, "decode_ms": 11.549124959856272}, "total_wall_ms": 38099.6261240216, "ttft_ms": 11.62362506147474, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2805 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2098f6b968e839a34bf81661", "attempt_id": "5f675f70215c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:25.843454Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 502, "message_tokens": 385, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37869.45949902292, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536}, "receiver_prefill_ms": 207.72512489929795, "ttft_ms": 11.560374987311661, "decode_ms": 11.518125073052943}, "total_wall_ms": 38100.68291600328, "ttft_ms": 11.560374987311661, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1fb6b0e63657986ace0df6d3c1195f462c1359afc69ed5a7dad3ca3220aa6437", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2806 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "47b0c435f5590667052b70cc", "attempt_id": "9f605633dd38", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:47.377868Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 496, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 205.95662505365908, "ttft_ms": 11.59316604025662, "decode_ms": 11.459583067335188}, "total_wall_ms": 59381.6127498867, "ttft_ms": 11.59316604025662, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2807 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "99a3d543aa37f01f328ea23a", "attempt_id": "9ab8015c9dc0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:47.623528Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 502, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.6960830707103, "ttft_ms": 11.563332984223962, "decode_ms": 114.8346250411123}, "total_wall_ms": 59485.684790997766, "ttft_ms": 11.563332984223962, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "d34fb8d4553d115f1c915ac9be75f68ef887916efddf5ed339f7cf4236ce8fa8"} | ||||
| 2808 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89a65bba6e1b336011f8aec9", "attempt_id": "20a4b51c9156", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:47.972924Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 502, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.66645804885775, "ttft_ms": 11.547207948751748, "decode_ms": 46.02350003551692}, "total_wall_ms": 59416.78358300123, "ttft_ms": 11.547207948751748, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 2809 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b00612f22399e784b78945b2", "attempt_id": "01cbb4d53e4c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:48.253248Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 499, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 210.11308289598674, "ttft_ms": 11.517458013258874, "decode_ms": 45.92083301395178}, "total_wall_ms": 59420.10579095222, "ttft_ms": 11.517458013258874, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 2810 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b66a30ba67b1da9ef5ac9a7", "attempt_id": "b74ae4e23191", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:48.536596Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 506, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 208.13258294947445, "ttft_ms": 11.538416962139308, "decode_ms": 11.483917012810707}, "total_wall_ms": 59383.72379099019, "ttft_ms": 11.538416962139308, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2811 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d81a69863438829b555f8f8f", "attempt_id": "f13f602f2686", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:48.783277Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 505, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.34704106487334, "ttft_ms": 11.641249991953373, "decode_ms": 92.6754999672994}, "total_wall_ms": 59463.234957889654, "ttft_ms": 11.641249991953373, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 2812 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bce7b4e9487dea641eff9f6b", "attempt_id": "70b01a767e43", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.109760Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 497, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 207.62108301278204, "ttft_ms": 11.487792013213038, "decode_ms": 22.975333034992218}, "total_wall_ms": 59394.65216593817, "ttft_ms": 11.487792013213038, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2813 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "11f6ab043bd0d6445d4a22fc", "attempt_id": "e1d62530d976", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.367570Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 498, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 206.44120790529996, "ttft_ms": 11.569041991606355, "decode_ms": 23.052542004734278}, "total_wall_ms": 59393.60666600987, "ttft_ms": 11.569041991606355, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 2814 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e69b55d29e1ef6ce3f95370", "attempt_id": "91ed5581f304", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.624050Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 514, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 209.82333295978606, "ttft_ms": 11.583083076402545, "decode_ms": 11.585792060941458}, "total_wall_ms": 59385.55579201784, "ttft_ms": 11.583083076402545, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2815 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "db2e2ca503c3437617be4518", "attempt_id": "2e08cbf2b593", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:49.872062Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 505, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 207.5721659930423, "ttft_ms": 11.556250043213367, "decode_ms": 11.70158397872001}, "total_wall_ms": 59383.36149987299, "ttft_ms": 11.556250043213367, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2816 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "554d52fa0c367eb1ec9d15aa", "attempt_id": "5324c66f387a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.118455Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 513, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 201.75858295988292, "ttft_ms": 12.069458025507629, "decode_ms": 11.520624975673854}, "total_wall_ms": 59377.917541889474, "ttft_ms": 12.069458025507629, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2817 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "316c03a73ff4f029fa238073", "attempt_id": "ada79664ec3a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.359256Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 509, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 209.5855000661686, "ttft_ms": 11.568957939743996, "decode_ms": 57.92950000613928}, "total_wall_ms": 59431.65408296045, "ttft_ms": 11.568957939743996, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,462,111", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "1e8c5e2011479311a255cce5a1f78bfee345f6bb870c300bc4a818f9676ae0f7"} | ||||
| 2818 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "daec267862fd7be55147e162", "attempt_id": "4eb8785ee3ae", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.653864Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 504, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 207.30849995743483, "ttft_ms": 11.553292046301067, "decode_ms": 11.53462496586144}, "total_wall_ms": 59382.938416907564, "ttft_ms": 11.553292046301067, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2819 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16ee8ff78db3d832aa9646c6", "attempt_id": "f12a737cf5bc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:50.899998Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 508, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 208.131332998164, "ttft_ms": 11.484291986562312, "decode_ms": 11.48550002835691}, "total_wall_ms": 59383.632665965706, "ttft_ms": 11.484291986562312, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2820 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "403a324c3a443931c24c3464", "attempt_id": "667c30b3b48f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:51.146374Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 511, "message_tokens": 394, "message_utf8_bytes": 1153, "cache_tensor_bytes": null, "serialized_payload_bytes": 1153, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 59152.118457946926, "hops": {"1": 22361.685457988642, "2": 5128.560750046745, "3": 5686.298708082177, "4": 4692.91458290536, "5": 5842.431625002064, "6": 4801.743416930549, "7": 5841.1449999548495, "8": 4797.338917036541}, "receiver_prefill_ms": 209.0514999581501, "ttft_ms": 11.6252499865368, "decode_ms": 11.530208983458579}, "total_wall_ms": 59384.7572079394, "ttft_ms": 11.6252499865368, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1179}, "2": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1181}, "3": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1095}, "4": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "5": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "6": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}, "7": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1111}, "8": {"facts_total": 65, "facts_retained": 38, "retention_rate": 0.5846153846153846, "retention_by_kind": {"person": 0.8333333333333334, "date": 0.7, "amount": 0.38461538461538464, "status": 1.0, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1153}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1d0e469668b88ffe7676989aa63ff9a7d27eb7c55484b06c14ba4e2a98a13623", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2821 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d94bd2b391c9476d7942e1a9", "attempt_id": "d24b59948acb", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.292749Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 460, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.3049589553848, "ttft_ms": 11.899915989488363, "decode_ms": 11.902792030014098}, "total_wall_ms": 7105.795498937368, "ttft_ms": 11.899915989488363, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2822 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c627238105d4610f85562eb6", "attempt_id": "a5f5dcd96290", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.519084Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.94200001098216, "ttft_ms": 11.91279198974371, "decode_ms": 11.917916941456497}, "total_wall_ms": 7106.413958012126, "ttft_ms": 11.91279198974371, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2823 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad23cd890228829d4da8d7a1", "attempt_id": "68906bce5b5d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.744947Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 466, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.74570794589818, "ttft_ms": 11.916583054699004, "decode_ms": 11.870707967318594}, "total_wall_ms": 7106.15970811341, "ttft_ms": 11.916583054699004, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2824 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "298ded8dadbaead1a4fe8379", "attempt_id": "e90500f4de7f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.970603Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 463, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.68716698791832, "ttft_ms": 11.910875095054507, "decode_ms": 11.900958023034036}, "total_wall_ms": 7106.149208033457, "ttft_ms": 11.910875095054507, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2825 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fdb95e87f6532bec0e8ea726", "attempt_id": "161443b5114e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.196006Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 470, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.10466609243304, "ttft_ms": 11.861750041134655, "decode_ms": 11.738874949514866}, "total_wall_ms": 7106.345208012499, "ttft_ms": 11.861750041134655, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2826 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4691649577f490c260a5e72b", "attempt_id": "590d592a7558", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.421712Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 471, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.07658299151808, "ttft_ms": 11.910666013136506, "decode_ms": 118.41008299961686}, "total_wall_ms": 7213.05958298035, "ttft_ms": 11.910666013136506, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MH-96F-2099", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "95c230d14a055d30e0e1d4355caf07808e1c968b1feab9e0607d8bd37b1b43dc"} | ||||
| 2827 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "21efce31b54db81fd2083aa9", "attempt_id": "9d1eaba4b5f2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.755399Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 461, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.44695805758238, "ttft_ms": 11.878374963998795, "decode_ms": 11.877959012053907}, "total_wall_ms": 7105.824374011718, "ttft_ms": 11.878374963998795, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2828 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "70651103e2d6240d7d54aa63", "attempt_id": "beaf88b29f38", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.980738Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 462, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.67370797973126, "ttft_ms": 11.92712492775172, "decode_ms": 11.881958926096559}, "total_wall_ms": 7106.162457959726, "ttft_ms": 11.92712492775172, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2829 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6bac3956a13836af56a96c9f", "attempt_id": "ec25bf611281", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:00.205976Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 478, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.0346250468865, "ttft_ms": 11.902834055945277, "decode_ms": 11.930583976209164}, "total_wall_ms": 7106.514499988407, "ttft_ms": 11.902834055945277, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2830 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ec08c98c3933b9421a97c0dd", "attempt_id": "3688ec5e64f1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:00.432038Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 469, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.93170901294798, "ttft_ms": 11.897167074494064, "decode_ms": 82.97449990641326}, "total_wall_ms": 7177.434250130318, "ttft_ms": 11.897167074494064, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5646720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "e1d129e860627cf4623671ed186cb4ebbf5d63169d3d0dc14a62e1da2af61326"} | ||||
| 2831 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "99ead5cb42605d885af16045", "attempt_id": "6006dfe167ac", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:00.728630Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 477, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.8581249145791, "ttft_ms": 12.082583038136363, "decode_ms": 59.241166920401156}, "total_wall_ms": 7154.818832990713, "ttft_ms": 12.082583038136363, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kovar-9", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "c969b5f7547945067f5b07e9f822d0043126326f979d950a8b1b045057fbb818"} | ||||
| 2832 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5e2d348c636307add8dd93fa", "attempt_id": "95599e5221b8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.002997Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 186.658582999371, "ttft_ms": 11.848250054754317, "decode_ms": 83.23183306492865}, "total_wall_ms": 7178.38500009384, "ttft_ms": 11.848250054754317, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9484825", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "667b970507c4c6c7fb572757eb3b5eb04186ddb67a6ef680266b7a0924737993"} | ||||
| 2833 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4cc7f5f99bcd42d25d3b32c8", "attempt_id": "db0b1823d1af", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.300606Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 468, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.568124987185, "ttft_ms": 11.901542078703642, "decode_ms": 47.460832982324064}, "total_wall_ms": 7141.546333092265, "ttft_ms": 11.901542078703642, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.3", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "8afb0bb35e730fd32e7805d65081241bd21f43709df37165f4ec91c763f8a99d"} | ||||
| 2834 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bd0dda3d16fc4715cfe7cd86", "attempt_id": "d57050504468", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.561261Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 473, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.87141600437462, "ttft_ms": 11.87141693662852, "decode_ms": 11.888000066392124}, "total_wall_ms": 7106.263792025857, "ttft_ms": 11.87141693662852, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2835 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6fb0cc24c8692d1e1421e0c", "attempt_id": "2263ec42fefc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:01.786559Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1914, "query_tokens": 475, "message_tokens": 379, "message_utf8_bytes": 900, "cache_tensor_bytes": null, "serialized_payload_bytes": 900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.219208021648, "hops": {"1": 6896.219208021648}, "receiver_prefill_ms": 185.947582940571, "ttft_ms": 12.029374949634075, "decode_ms": 11.90191600471735}, "total_wall_ms": 7106.496624997817, "ttft_ms": 12.029374949634075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "2ae8e199245ad716748b3e420d7b2c8e50b7daeeebd965effa93b31557ba8942", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2836 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ee5cdf80b64d488a3b00110", "attempt_id": "0eb57dbca981", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:06.307676Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 452, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 200.07650007028133, "ttft_ms": 11.643542093224823, "decode_ms": 11.542499996721745}, "total_wall_ms": 11414.357333094813, "ttft_ms": 11.643542093224823, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2837 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4519603f860f348a0a6c6b2d", "attempt_id": "ebd3a9b74a86", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:06.547993Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.44499994441867, "ttft_ms": 11.635957984253764, "decode_ms": 11.510084033943713}, "total_wall_ms": 11416.62091598846, "ttft_ms": 11.635957984253764, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2838 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0210c299a673a58a8657a332", "attempt_id": "f57bb37548a9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:06.790192Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.78220798354596, "ttft_ms": 11.736541986465454, "decode_ms": 11.570625007152557}, "total_wall_ms": 11417.214958113618, "ttft_ms": 11.736541986465454, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2839 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c81f41666a0553f5a57da6eb", "attempt_id": "d81a7cc6762e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.032580Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 455, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 201.61716593429446, "ttft_ms": 11.642958037555218, "decode_ms": 11.505665956065059}, "total_wall_ms": 11415.777583024465, "ttft_ms": 11.642958037555218, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2840 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ff5dbe3458154d43b364f052", "attempt_id": "b993906eee4b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.273243Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 462, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.95933301188052, "ttft_ms": 11.543333996087313, "decode_ms": 11.669458006508648}, "total_wall_ms": 11418.174999998882, "ttft_ms": 11.543333996087313, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2841 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "28281e6eec70eee2481a6751", "attempt_id": "5d4bd0a99718", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.516176Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.4829999320209, "ttft_ms": 11.53916702605784, "decode_ms": 11.539792059920728}, "total_wall_ms": 11417.54320799373, "ttft_ms": 11.53916702605784, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2842 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc418b36d9accce7b295a3e3", "attempt_id": "c706385040be", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.758247Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 453, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.41237501613796, "ttft_ms": 11.804334004409611, "decode_ms": 23.27070792671293}, "total_wall_ms": 11428.596249083057, "ttft_ms": 11.804334004409611, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2843 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03dab83f7c9088cb70f1f04f", "attempt_id": "8074c2d95dc9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.011637Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 454, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 199.69187502283603, "ttft_ms": 11.559708043932915, "decode_ms": 11.51358406059444}, "total_wall_ms": 11413.757000002079, "ttft_ms": 11.559708043932915, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2844 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fbd28c25e407a34fa567bdb9", "attempt_id": "a6f8fc675d36", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.250525Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 470, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 204.81916691642255, "ttft_ms": 11.57983299344778, "decode_ms": 11.55637507326901}, "total_wall_ms": 11418.969124089926, "ttft_ms": 11.57983299344778, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2845 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3367c76ca1ea311009197e69", "attempt_id": "4a9a55e26ed9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.494368Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.2025830121711, "ttft_ms": 11.617250042036176, "decode_ms": 11.478040949441493}, "total_wall_ms": 11417.28666704148, "ttft_ms": 11.617250042036176, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2846 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d07793136fa65ff0a9ef5424", "attempt_id": "3dd7673edfd8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.736237Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 469, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.61879095435143, "ttft_ms": 11.561291990801692, "decode_ms": 11.525708017870784}, "total_wall_ms": 11417.696125106886, "ttft_ms": 11.561291990801692, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2847 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "310b3a162b944435e740c295", "attempt_id": "b2e905b5590e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:08.978325Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 465, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.004500082694, "ttft_ms": 11.60787499975413, "decode_ms": 57.55241704173386}, "total_wall_ms": 11462.183666066267, "ttft_ms": 11.60787499975413, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,646,720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "2c0bb14ad8ba61e6d23fb3dea5205f2f02c43c95a0cf8e7f93c240ddea626ad4"} | ||||
| 2848 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cc7d9218e620071898a4957b", "attempt_id": "4131ea95c074", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:09.264754Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 460, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 202.61016709264368, "ttft_ms": 11.743166018277407, "decode_ms": 11.507582967169583}, "total_wall_ms": 11416.990875033662, "ttft_ms": 11.743166018277407, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2849 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e762b48fc37a7271532bdabc", "attempt_id": "01e20a9e4f12", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:09.506764Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 464, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 203.15854204818606, "ttft_ms": 11.63029100280255, "decode_ms": 11.580833001062274}, "total_wall_ms": 11417.369041126221, "ttft_ms": 11.63029100280255, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2850 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d258f30414555b6c349fd536", "attempt_id": "f3e75c686786", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:09.750179Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 467, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11190.593583043665, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165}, "receiver_prefill_ms": 206.60366595257074, "ttft_ms": 11.58149994444102, "decode_ms": 11.544415960088372}, "total_wall_ms": 11420.725042000413, "ttft_ms": 11.58149994444102, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2851 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8f51afd6a3544ce47ce942b1", "attempt_id": "b3f44e92663a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.234183Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 452, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 200.9144159965217, "ttft_ms": 11.578792007640004, "decode_ms": 11.575500015169382}, "total_wall_ms": 20651.235541095957, "ttft_ms": 11.578792007640004, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2852 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e4298900a03447465092fed8", "attempt_id": "1d53ea775d50", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.475048Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.46641694009304, "ttft_ms": 11.554333032108843, "decode_ms": 11.557165998965502}, "total_wall_ms": 20651.710916077718, "ttft_ms": 11.554333032108843, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2853 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c37b86cc101392b4e8285445", "attempt_id": "a99efe5d33dd", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.715598Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.89791696611792, "ttft_ms": 11.592500028200448, "decode_ms": 11.51408301666379}, "total_wall_ms": 20652.13854110334, "ttft_ms": 11.592500028200448, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2854 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7c6a520be8ad0b768553c595", "attempt_id": "99eef91f6b57", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:19.956900Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 455, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.12816607858986, "ttft_ms": 11.556084034964442, "decode_ms": 11.61312498152256}, "total_wall_ms": 20654.435958131216, "ttft_ms": 11.556084034964442, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2855 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "efe37abcbe89ef07627af361", "attempt_id": "e072f435244f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.199770Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 462, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 202.47225009370595, "ttft_ms": 11.574000003747642, "decode_ms": 11.491082957945764}, "total_wall_ms": 20652.672000112943, "ttft_ms": 11.574000003747642, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2856 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "107b07f4145dc353204941b7", "attempt_id": "d7e68286f56b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.440472Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.78941695485264, "ttft_ms": 11.508582974784076, "decode_ms": 11.591374990530312}, "total_wall_ms": 20652.00604114216, "ttft_ms": 11.508582974784076, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2857 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4e18f2a58fbce166f190266a", "attempt_id": "a66e4550b950", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.681374Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 453, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 201.94341707974672, "ttft_ms": 11.617708951234818, "decode_ms": 22.87674997933209}, "total_wall_ms": 20663.58983318787, "ttft_ms": 11.617708951234818, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2858 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f2ce6f482e9f27ffae024381", "attempt_id": "dca34cf1804f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:20.932602Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 454, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 200.86958399042487, "ttft_ms": 11.52995799202472, "decode_ms": 11.586250038817525}, "total_wall_ms": 20651.094458065927, "ttft_ms": 11.52995799202472, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2859 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f4011ae97631851c3ee7e766", "attempt_id": "d466ff971558", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.172480Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 470, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.5193329686299, "ttft_ms": 11.535957921296358, "decode_ms": 11.52787497267127}, "total_wall_ms": 20654.727374087088, "ttft_ms": 11.535957921296358, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2860 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae4a65c8cac8fe92ce597634", "attempt_id": "ac2cc66452c4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.415617Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 203.30787496641278, "ttft_ms": 11.5481250686571, "decode_ms": 11.503709014505148}, "total_wall_ms": 20653.487000148743, "ttft_ms": 11.5481250686571, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2861 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b171b72fc315c9e512c9c1ab", "attempt_id": "df8d91e4625f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.657764Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 469, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 208.12520803883672, "ttft_ms": 11.61370798945427, "decode_ms": 11.469958000816405}, "total_wall_ms": 20658.339500194415, "ttft_ms": 11.61370798945427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2862 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "acc849b3d08b2c5057915d7c", "attempt_id": "43f3de5bba98", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.904469Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 465, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.23579204361886, "ttft_ms": 11.56979100778699, "decode_ms": 57.78304091654718}, "total_wall_ms": 20700.720541062765, "ttft_ms": 11.56979100778699, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,646,720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "2c0bb14ad8ba61e6d23fb3dea5205f2f02c43c95a0cf8e7f93c240ddea626ad4"} | ||||
| 2863 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80b55c21aa769e11f06232e2", "attempt_id": "806784074db2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:22.193386Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 460, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 203.2241669949144, "ttft_ms": 11.535875033587217, "decode_ms": 11.553250020369887}, "total_wall_ms": 20653.444375027902, "ttft_ms": 11.535875033587217, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2864 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2045fa722f973b166629ff76", "attempt_id": "5194ab2ee3c4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:22.435091Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 464, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.76945908740163, "ttft_ms": 11.539041996002197, "decode_ms": 11.492499965243042}, "total_wall_ms": 20654.90045817569, "ttft_ms": 11.539041996002197, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2865 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "277cd0ddb1dc0228579c6f0b", "attempt_id": "5e894ac62eb3", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:22.678642Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 467, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20426.742333103903, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675}, "receiver_prefill_ms": 204.35237500350922, "ttft_ms": 11.583790997974575, "decode_ms": 11.511042015627027}, "total_wall_ms": 20654.59216607269, "ttft_ms": 11.583790997974575, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2866 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8684cca1bde15a7bf65cb552", "attempt_id": "66022a20a14e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:41.408286Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 452, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 200.94579097349197, "ttft_ms": 11.417291942052543, "decode_ms": 11.446291930042207}, "total_wall_ms": 39132.63620832004, "ttft_ms": 11.417291942052543, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2867 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5168a70642e8a5690249bd9b", "attempt_id": "f0c41f519d89", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:41.648717Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 200.74433297850192, "ttft_ms": 11.597416014410555, "decode_ms": 11.473416001535952}, "total_wall_ms": 39132.653500302695, "ttft_ms": 11.597416014410555, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2868 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b0c25fc019d195294f129824", "attempt_id": "8b740728e3ce", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:41.888559Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 458, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.5256670312956, "ttft_ms": 11.530166957527399, "decode_ms": 11.525416048243642}, "total_wall_ms": 39134.37458325643, "ttft_ms": 11.530166957527399, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2869 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0753c06f450b0678c6344cba", "attempt_id": "c09165b2ab24", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.129945Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 455, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 203.65537505131215, "ttft_ms": 11.6252499865368, "decode_ms": 11.536624981090426}, "total_wall_ms": 39135.623958311044, "ttft_ms": 11.6252499865368, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2870 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7658de8168a54706ea455ea9", "attempt_id": "ed79af2a252d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.372543Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 462, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 200.44012495782226, "ttft_ms": 11.534958030097187, "decode_ms": 11.554750031791627}, "total_wall_ms": 39132.342500262894, "ttft_ms": 11.534958030097187, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2871 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "86558a65a115b2723d2ca5d1", "attempt_id": "584f714fa3cd", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.611746Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 203.5017079906538, "ttft_ms": 11.600124998949468, "decode_ms": 11.545417015440762}, "total_wall_ms": 39135.43791731354, "ttft_ms": 11.600124998949468, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2872 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4705add754afca10dd943642", "attempt_id": "109062cabb54", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:42.854345Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 453, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.36729201860726, "ttft_ms": 11.570916045457125, "decode_ms": 23.007625015452504}, "total_wall_ms": 39145.730374148116, "ttft_ms": 11.570916045457125, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2873 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "29acfc567719fb94547bab5c", "attempt_id": "4e95b5ef1d66", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.106889Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 454, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.103832969442, "ttft_ms": 11.636374983936548, "decode_ms": 11.507041985169053}, "total_wall_ms": 39134.05295822304, "ttft_ms": 11.636374983936548, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2874 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "203b89cda76a88117927acfd", "attempt_id": "5d3ae8fda989", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.347861Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 470, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 202.15658308006823, "ttft_ms": 11.588749941438437, "decode_ms": 11.586457956582308}, "total_wall_ms": 39134.16225020774, "ttft_ms": 11.588749941438437, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2875 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb0112a54b2ab91530061881", "attempt_id": "b4625ba61717", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.588943Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 461, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 201.65483397431672, "ttft_ms": 11.532332981005311, "decode_ms": 11.554541997611523}, "total_wall_ms": 39133.52791615762, "ttft_ms": 11.532332981005311, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2876 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0ec1d9f0601ce9b0d52e097", "attempt_id": "f119ec23efa4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.829172Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 469, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 207.1392919169739, "ttft_ms": 11.553416028618813, "decode_ms": 11.523749912157655}, "total_wall_ms": 39139.00450034998, "ttft_ms": 11.553416028618813, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2877 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "12056658164e80e5b64a4408", "attempt_id": "6f8c86e6c2bc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.074741Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 465, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 203.10245803557336, "ttft_ms": 11.572084040381014, "decode_ms": 57.69333301577717}, "total_wall_ms": 39181.191000156105, "ttft_ms": 11.572084040381014, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,646,720", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "2c0bb14ad8ba61e6d23fb3dea5205f2f02c43c95a0cf8e7f93c240ddea626ad4"} | ||||
| 2878 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4c5ddf64c06c4bf305520ffd", "attempt_id": "985c363a0213", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.362681Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 460, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 201.77362498361617, "ttft_ms": 11.604042025282979, "decode_ms": 11.506457929499447}, "total_wall_ms": 39133.6852501845, "ttft_ms": 11.604042025282979, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2879 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "293149f634f67396053180ce", "attempt_id": "dcd61e6735b2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.603148Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 464, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 204.5530000468716, "ttft_ms": 11.566541972570121, "decode_ms": 11.507750023156404}, "total_wall_ms": 39136.406833305955, "ttft_ms": 11.566541972570121, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2880 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da6f4356196da5ddf1f1bc9f", "attempt_id": "c93620885371", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.846193Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1725, "query_tokens": 467, "message_tokens": 350, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38908.40608323924, "hops": {"1": 6896.219208021648, "2": 4294.3743750220165, "3": 4930.94241595827, "4": 4305.2063341019675, "5": 4931.834749993868, "6": 4301.946583087556, "7": 4939.746499992907, "8": 4308.1359170610085}, "receiver_prefill_ms": 205.05233306903392, "ttft_ms": 11.624832986854017, "decode_ms": 11.526959016919136}, "total_wall_ms": 39136.99137524236, "ttft_ms": 11.624832986854017, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "ledger_by_hop": {"1": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 836}, "2": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "3": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "4": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "5": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "6": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "7": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}, "8": {"facts_total": 65, "facts_retained": 19, "retention_rate": 0.2923076923076923, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.1, "amount": 0.15384615384615385, "status": 1.0, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 985}}}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dc8b132a30e8989cf3c15b7b1a161c9730440bcba369b175bdd47033bb2266fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2881 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f94f53a18e209d47bfb8ddd", "attempt_id": "ec035f1a57c0", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.137546Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.33754105865955, "ttft_ms": 11.96925004478544, "decode_ms": 11.930791893973947}, "total_wall_ms": 7217.62954199221, "ttft_ms": 11.96925004478544, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2882 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6e4edc15fcdb423774811fe5", "attempt_id": "9b2dbf8d61df", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.405480Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.46345796622336, "ttft_ms": 11.999250040389597, "decode_ms": 11.93166698794812}, "total_wall_ms": 7217.751334072091, "ttft_ms": 11.999250040389597, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2883 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5dfa922561234f365efc4e06", "attempt_id": "b35ff64d0baa", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.673131Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.3631250243634, "ttft_ms": 11.959125055000186, "decode_ms": 83.38604203891009}, "total_wall_ms": 7288.033208111301, "ttft_ms": 11.959125055000186, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 2884 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b5efa056aa8a9ab05e5a1ea1", "attempt_id": "8b686fd86132", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.010857Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.75329202320427, "ttft_ms": 11.945249978452921, "decode_ms": 12.137541081756353}, "total_wall_ms": 7217.132042045705, "ttft_ms": 11.945249978452921, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2885 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c837f57c51575c785d18044", "attempt_id": "0585fa7f8963", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.277268Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.10254206322134, "ttft_ms": 11.983082978986204, "decode_ms": 107.37483308184892}, "total_wall_ms": 7312.79041711241, "ttft_ms": 11.983082978986204, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 2886 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df42cc1d9e3606b312e48498", "attempt_id": "ef899a5d9889", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.639445Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.3269579745829, "ttft_ms": 12.147915898822248, "decode_ms": 12.042958987876773}, "total_wall_ms": 7217.956667067483, "ttft_ms": 12.147915898822248, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2887 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71c20d3d7f450645cb2b88f2", "attempt_id": "4c0a3b666a66", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:53.906924Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.65075003169477, "ttft_ms": 11.850790935568511, "decode_ms": 11.824292014352977}, "total_wall_ms": 7216.691459063441, "ttft_ms": 11.850790935568511, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2888 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "20691cdd16bcd0ee2b7376ce", "attempt_id": "53cd8bbb4df2", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.173242Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.6510840272531, "ttft_ms": 12.024041963741183, "decode_ms": 11.98533398564905}, "total_wall_ms": 7216.995583148673, "ttft_ms": 12.024041963741183, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2889 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e325942b42e596df339f4ce2", "attempt_id": "b84a2ed3fc50", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.440186Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 229.6456249896437, "ttft_ms": 12.049874989315867, "decode_ms": 11.993665946647525}, "total_wall_ms": 7220.0570000568405, "ttft_ms": 12.049874989315867, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2890 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8992ac2d14527f84647b37e4", "attempt_id": "eba93941dcbd", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.709948Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.03824995551258, "ttft_ms": 12.024249997921288, "decode_ms": 11.960541014559567}, "total_wall_ms": 7217.3483750084415, "ttft_ms": 12.024249997921288, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2891 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "714a3b5afc6e23c38f513703", "attempt_id": "dc9527a73532", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.976827Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 229.2202499229461, "ttft_ms": 12.016541906632483, "decode_ms": 11.87279203440994}, "total_wall_ms": 7219.4512920686975, "ttft_ms": 12.016541906632483, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2892 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d242cfb6a8997d4430ef185c", "attempt_id": "2b7e40d65534", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:55.246057Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.04345802776515, "ttft_ms": 12.091790908016264, "decode_ms": 83.68970802985132}, "total_wall_ms": 7289.284917060286, "ttft_ms": 12.091790908016264, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 2893 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1464ad9d7ff02bdb87b9ffa8", "attempt_id": "3c39669a8a37", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:55.584340Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 226.7504578921944, "ttft_ms": 12.062042020261288, "decode_ms": 11.881207930855453}, "total_wall_ms": 7217.175125959329, "ttft_ms": 12.062042020261288, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2894 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9ab0b72e3db8ca45d469b799", "attempt_id": "a55451fc0127", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:55.851616Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.45554195716977, "ttft_ms": 12.18508300371468, "decode_ms": 12.01075001154095}, "total_wall_ms": 7218.157959054224, "ttft_ms": 12.18508300371468, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2895 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b56cb03e9a57414caae162ea", "attempt_id": "48c7a46ea91f", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:56.120825Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6965.8001670613885, "hops": {"1": 6965.8001670613885}, "receiver_prefill_ms": 227.2582909790799, "ttft_ms": 11.99937507044524, "decode_ms": 12.003959040157497}, "total_wall_ms": 7217.628707992844, "ttft_ms": 11.99937507044524, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2896 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "753f744d5590b2274579aaaa", "attempt_id": "3a6577be9302", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:02.774149Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.68308403808624, "ttft_ms": 11.846457957290113, "decode_ms": 11.902624974027276}, "total_wall_ms": 13600.601210142486, "ttft_ms": 11.846457957290113, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2897 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e39732132c6f0d74391922ec", "attempt_id": "20e5b09ce7ad", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.041491Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.7764579737559, "ttft_ms": 11.951458058319986, "decode_ms": 11.919416952878237}, "total_wall_ms": 13600.782084162347, "ttft_ms": 11.951458058319986, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2898 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "baeb2d37a0177444fe208edd", "attempt_id": "b5dd2a0849b9", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.308153Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.385583053343, "ttft_ms": 12.16383301652968, "decode_ms": 84.16995801962912}, "total_wall_ms": 13673.025210155174, "ttft_ms": 12.16383301652968, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 2899 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5af9030e32b929ada6ae4d65", "attempt_id": "e81ec9708515", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.646825Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.614834042266, "ttft_ms": 12.10945809725672, "decode_ms": 12.029916979372501}, "total_wall_ms": 13601.05179308448, "ttft_ms": 12.10945809725672, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2900 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2b0289cc401be1a010b7970e", "attempt_id": "205c4aa8f5bd", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:03.914060Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.63891699630767, "ttft_ms": 11.959582916460931, "decode_ms": 107.48100001364946}, "total_wall_ms": 13696.246209088713, "ttft_ms": 11.959582916460931, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 2901 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49d09c2a99ad0f6c510fe16c", "attempt_id": "333621cb6a37", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:04.277096Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.90795792732388, "ttft_ms": 11.956249945797026, "decode_ms": 12.165375053882599}, "total_wall_ms": 13601.181835052557, "ttft_ms": 11.956249945797026, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2902 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e771788796b151bfd01affc6", "attempt_id": "adc35ad88ada", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:04.543903Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.6862919786945, "ttft_ms": 11.993833002634346, "decode_ms": 11.997084016911685}, "total_wall_ms": 13600.79825099092, "ttft_ms": 11.993833002634346, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2903 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a73dc4b558ae698227c1b34c", "attempt_id": "4fb299208db8", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:04.810395Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 226.766207953915, "ttft_ms": 11.945624952204525, "decode_ms": 11.92041696049273}, "total_wall_ms": 13600.741876056418, "ttft_ms": 11.945624952204525, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2904 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6779ed992be9c3bd7594f65c", "attempt_id": "be021fa9a18a", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.076781Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 229.57179101649672, "ttft_ms": 12.232957989908755, "decode_ms": 11.908375076018274}, "total_wall_ms": 13603.986417059787, "ttft_ms": 12.232957989908755, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2905 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9df0f4564d4b81ae7ac37146", "attempt_id": "54eec9ad4c02", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.346551Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.05583297647536, "ttft_ms": 12.183125014416873, "decode_ms": 11.90149993635714}, "total_wall_ms": 13601.28316807095, "ttft_ms": 12.183125014416873, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2906 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "75d767fc490e28cee390633b", "attempt_id": "7ea57903743a", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.613935Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 229.49620801955462, "ttft_ms": 11.895584058947861, "decode_ms": 11.921458994038403}, "total_wall_ms": 13603.455210104585, "ttft_ms": 11.895584058947861, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2907 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ba97a7bffcd10007b5c6a840", "attempt_id": "e914bfbd5cd2", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:05.883243Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.29645809158683, "ttft_ms": 11.892999988049269, "decode_ms": 83.18300009705126}, "total_wall_ms": 13672.52783512231, "ttft_ms": 11.892999988049269, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 2908 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02bd6a199cfb3648b21e2001", "attempt_id": "2cd7243371e7", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:06.221612Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.43054199963808, "ttft_ms": 11.801416985690594, "decode_ms": 11.833208962343633}, "total_wall_ms": 13601.18412610609, "ttft_ms": 11.801416985690594, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2909 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0e3ca81812ba9a2213a67243", "attempt_id": "f02994db75e3", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:06.488573Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.21154196187854, "ttft_ms": 11.821249965578318, "decode_ms": 11.791165918111801}, "total_wall_ms": 13600.940084084868, "ttft_ms": 11.821249965578318, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2910 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "77a55ff61a5cdb2f879b907c", "attempt_id": "7ff7f01f492d", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:06.754885Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13349.597501102835, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446}, "receiver_prefill_ms": 227.14358288794756, "ttft_ms": 11.809874908067286, "decode_ms": 11.813458055257797}, "total_wall_ms": 13600.895918090828, "ttft_ms": 11.809874908067286, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2911 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "726fbb3883c8b239a09d00f6", "attempt_id": "8bd825633ac5", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:19.667794Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.7713330220431, "ttft_ms": 11.888499953784049, "decode_ms": 11.843792046420276}, "total_wall_ms": 26244.002543156967, "ttft_ms": 11.888499953784049, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2912 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "408729447d65b602d16fda14", "attempt_id": "a416a32a0131", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:19.935054Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.02529199887067, "ttft_ms": 11.941000004298985, "decode_ms": 11.769249918870628}, "total_wall_ms": 26244.22429315746, "ttft_ms": 11.941000004298985, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2913 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8118c69625bce55bc1b63621", "attempt_id": "5e81113ab588", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:20.202408Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.03762503806502, "ttft_ms": 11.819500010460615, "decode_ms": 82.41174998693168}, "total_wall_ms": 26314.70904313028, "ttft_ms": 11.819500010460615, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 2914 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b41c2cd136f522f97551146f", "attempt_id": "53ab612bb802", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:20.539873Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.2377500301227, "ttft_ms": 11.864291969686747, "decode_ms": 11.791291064582765}, "total_wall_ms": 26243.310668156482, "ttft_ms": 11.864291969686747, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2915 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9264f3eb2fa8e2bc881a3644", "attempt_id": "4cc7500fc678", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:20.805585Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.80370800662786, "ttft_ms": 11.763916932977736, "decode_ms": 105.7549580000341}, "total_wall_ms": 26337.785501149483, "ttft_ms": 11.763916932977736, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 2916 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "379fdd74771035e2eb6e28a3", "attempt_id": "bfabffb1648e", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.165503Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.89308295957744, "ttft_ms": 11.791458004154265, "decode_ms": 11.826207977719605}, "total_wall_ms": 26243.955460144207, "ttft_ms": 11.791458004154265, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2917 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a1c0cc02f0feb55977a59249", "attempt_id": "4b5e754b980d", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.431760Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.97441698983312, "ttft_ms": 11.828124988824129, "decode_ms": 11.864541913382709}, "total_wall_ms": 26244.10158523824, "ttft_ms": 11.828124988824129, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2918 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cfd7f566c9336b798f169eef", "attempt_id": "0d87558657c2", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.698172Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.1051249699667, "ttft_ms": 11.855500051751733, "decode_ms": 11.904416023753583}, "total_wall_ms": 26244.29912713822, "ttft_ms": 11.855500051751733, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2919 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a21f1bbe758ee8cef8f172c3", "attempt_id": "2cbd47ca92e9", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:21.965020Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 229.09416700713336, "ttft_ms": 11.718250112608075, "decode_ms": 11.877542012371123}, "total_wall_ms": 26246.146918158047, "ttft_ms": 11.718250112608075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2920 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "58d9a604baa62d519acba4ee", "attempt_id": "de7fc439cc86", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:22.233270Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.9183750031516, "ttft_ms": 11.839916929602623, "decode_ms": 11.85870892368257}, "total_wall_ms": 26244.057793170214, "ttft_ms": 11.839916929602623, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2921 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "73c3858f29e819400209778f", "attempt_id": "a32525a59de5", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:22.500143Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 229.04245904646814, "ttft_ms": 11.789832962676883, "decode_ms": 11.730375001206994}, "total_wall_ms": 26246.00646016188, "ttft_ms": 11.789832962676883, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2922 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "58d2d7acf81624a6f0c6dda3", "attempt_id": "c98af0ed5f82", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:22.768782Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.17649990227073, "ttft_ms": 12.067832984030247, "decode_ms": 82.63779198750854}, "total_wall_ms": 26315.369501244277, "ttft_ms": 12.067832984030247, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 2923 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "724f02747b38012dd4315efb", "attempt_id": "ab1a4f595e42", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:23.107341Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.6135000390932, "ttft_ms": 11.80862495675683, "decode_ms": 11.871666996739805}, "total_wall_ms": 26243.756584241055, "ttft_ms": 11.80862495675683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2924 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "21be50c1530487d70d7108d6", "attempt_id": "e8a6251fe433", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:23.373315Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 226.42879199702293, "ttft_ms": 11.861625011079013, "decode_ms": 11.85912499204278}, "total_wall_ms": 26243.610210251063, "ttft_ms": 11.861625011079013, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2925 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef5155954acc1c0016fa85be", "attempt_id": "c49f4b2a1761", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:23.639231Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25992.931168177165, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165}, "receiver_prefill_ms": 227.08595800213516, "ttft_ms": 12.17612496111542, "decode_ms": 11.82437501847744}, "total_wall_ms": 26244.54262619838, "ttft_ms": 12.17612496111542, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2926 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751370cd81892dd40de17903", "attempt_id": "769757d4d58d", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:49.213249Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 226.88433295115829, "ttft_ms": 12.047790922224522, "decode_ms": 11.889833025634289}, "total_wall_ms": 51545.84158421494, "ttft_ms": 12.047790922224522, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2927 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "880b3a3219cb96b64f4ccaf4", "attempt_id": "b087eaeacc35", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:49.480557Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.0825420273468, "ttft_ms": 11.990125058218837, "decode_ms": 11.91887492313981}, "total_wall_ms": 51545.9824182326, "ttft_ms": 11.990125058218837, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2928 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1dd3029f476bf30c5bc5707", "attempt_id": "bc96537f758d", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:49.747123Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.089999942109, "ttft_ms": 12.071042088791728, "decode_ms": 82.94683299027383}, "total_wall_ms": 51617.09904228337, "ttft_ms": 12.071042088791728, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 2929 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "565e07b4e0655f8bacabac69", "attempt_id": "1b59b9220139", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.085031Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.21041610930115, "ttft_ms": 11.838041944429278, "decode_ms": 11.842875042930245}, "total_wall_ms": 51545.88004213292, "ttft_ms": 11.838041944429278, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2930 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6ce8280ab8b1f23b48b50e5", "attempt_id": "25daa4a443a8", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.351570Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.19112504273653, "ttft_ms": 11.835957993753254, "decode_ms": 106.63254198152572}, "total_wall_ms": 51640.638959244825, "ttft_ms": 11.835957993753254, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 2931 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b453767f8031f595750575f", "attempt_id": "a2ea420b2a16", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.712977Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.34225005842745, "ttft_ms": 11.902292026206851, "decode_ms": 11.866874992847443}, "total_wall_ms": 51546.0947091924, "ttft_ms": 11.902292026206851, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2932 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "113e37ab97f0e52acb231f53", "attempt_id": "3d0b15461043", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.979840Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 226.8207500455901, "ttft_ms": 11.867458000779152, "decode_ms": 11.909457971341908}, "total_wall_ms": 51545.57116725482, "ttft_ms": 11.867458000779152, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2933 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da5ac261e1d1012fb619c1c6", "attempt_id": "4a72e4c1f38c", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:51.245966Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 226.81791603099555, "ttft_ms": 12.087582959793508, "decode_ms": 11.90095895435661}, "total_wall_ms": 51545.81116826739, "ttft_ms": 12.087582959793508, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2934 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "203e68c27d9d23918f1d07cd", "attempt_id": "8c48eb1ca7ec", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:51.512118Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 228.855749941431, "ttft_ms": 12.015124899335206, "decode_ms": 11.869041016325355}, "total_wall_ms": 51547.71729221102, "ttft_ms": 12.015124899335206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2935 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "12e68f1843b22f3e1c63ca8f", "attempt_id": "fcc416ee8e86", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:51.780479Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.07966703455895, "ttft_ms": 12.022125069051981, "decode_ms": 11.914458009414375}, "total_wall_ms": 51546.01620929316, "ttft_ms": 12.022125069051981, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2936 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ec61b8c3502b3dd603f5b34", "attempt_id": "c2c2c824e6f2", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.047154Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 229.16283400263637, "ttft_ms": 11.858124984428287, "decode_ms": 11.946166981942952}, "total_wall_ms": 51547.945667174645, "ttft_ms": 11.858124984428287, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2937 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1d0d129ea06720cfa36d3a6f", "attempt_id": "68c3d99dd648", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.315792Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.40304097533226, "ttft_ms": 11.915542068891227, "decode_ms": 82.97120907809585}, "total_wall_ms": 51617.27400019299, "ttft_ms": 11.915542068891227, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 2938 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02c02a185e7fd154972915ca", "attempt_id": "f4d5caed64a8", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.653727Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.34025004319847, "ttft_ms": 11.922917095944285, "decode_ms": 11.88620796892792}, "total_wall_ms": 51546.11158417538, "ttft_ms": 11.922917095944285, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2939 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7372cffe659dae5fcf305de9", "attempt_id": "39d376023187", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:52.920359Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.38029202446342, "ttft_ms": 11.933458037674427, "decode_ms": 11.882791994139552}, "total_wall_ms": 51546.17308429442, "ttft_ms": 11.933458037674427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2940 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aaa3fa059e7f87cdad36afbb", "attempt_id": "d98f39344b57", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:53.186754Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51294.487459235825, "hops": {"1": 6965.8001670613885, "2": 6383.797334041446, "3": 6320.953875081614, "4": 6322.3797919927165, "5": 6315.4535830253735, "6": 6335.9819169854745, "7": 6312.74179101456, "8": 6337.379000033252}, "receiver_prefill_ms": 227.1588749717921, "ttft_ms": 11.959374998696148, "decode_ms": 11.879750061780214}, "total_wall_ms": 51545.975125278346, "ttft_ms": 11.959374998696148, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2941 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5c0a46794d470a83dc5eaf06", "attempt_id": "f6a53a4ae398", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:00.391363Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.26933300681412, "ttft_ms": 11.80416694842279, "decode_ms": 11.790709104388952}, "total_wall_ms": 7124.787209089845, "ttft_ms": 11.80416694842279, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2942 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a054945779b95b752f6a5b5", "attempt_id": "b9fefcd8a26d", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:00.595688Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.79070798959583, "ttft_ms": 12.047125026583672, "decode_ms": 130.07595902308822}, "total_wall_ms": 7243.934668018483, "ttft_ms": 12.047125026583672, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 2943 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6c1dfbb4e681b18651889980", "attempt_id": "a001a2bb4d9c", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:00.918833Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 165.1084590703249, "ttft_ms": 11.83262502308935, "decode_ms": 11.728542041964829}, "total_wall_ms": 7125.536459032446, "ttft_ms": 11.83262502308935, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2944 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "002b83b453a65db7e45424d8", "attempt_id": "1dddba50ec46", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.124226Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.0583339612931, "ttft_ms": 12.081082910299301, "decode_ms": 11.792624951340258}, "total_wall_ms": 7124.9332500156015, "ttft_ms": 12.081082910299301, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2945 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "63e2b46825b1675b0b6f8fb1", "attempt_id": "f04a9c2fefc3", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.328199Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.67762493994087, "ttft_ms": 11.896417010575533, "decode_ms": 11.777332983911037}, "total_wall_ms": 7125.347375986166, "ttft_ms": 11.896417010575533, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2946 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eab56dedd883c8843d5ff1cb", "attempt_id": "903634cd4f59", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.533843Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 184.89924992900342, "ttft_ms": 12.040583998896182, "decode_ms": 11.881624930538237}, "total_wall_ms": 7145.81962605007, "ttft_ms": 12.040583998896182, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2947 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b8da8ea509495646817ef35e", "attempt_id": "e9cddc7c6db5", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.759234Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 439, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.23270793166012, "ttft_ms": 11.796916020102799, "decode_ms": 11.788291041739285}, "total_wall_ms": 7124.669751035981, "ttft_ms": 11.796916020102799, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2948 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bedfd838642aeacb43c7693e", "attempt_id": "16774b407c62", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.963156Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 441, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 164.2329579917714, "ttft_ms": 11.775291990488768, "decode_ms": 11.805000016465783}, "total_wall_ms": 7124.653875012882, "ttft_ms": 11.775291990488768, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2949 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0155b74fcff3d4ac35ff5f40", "attempt_id": "b6ea30e798b4", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.166460Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.86870795115829, "ttft_ms": 11.836208985187113, "decode_ms": 11.81591593194753}, "total_wall_ms": 7146.448876010254, "ttft_ms": 11.836208985187113, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2950 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ee38a8c6ca620154c4030cb8", "attempt_id": "d0c81646384e", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.392062Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 165.6753340503201, "ttft_ms": 11.78512501064688, "decode_ms": 82.25158299319446}, "total_wall_ms": 7196.570542058907, "ttft_ms": 11.78512501064688, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9134435", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "f7384892cb4f9a38f6115f91da5fec3f0d7e24e47877737b0f34e2b4a6af7d5a"} | ||||
| 2951 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c2ac17ce3dc8a07f36ec94ec", "attempt_id": "9e15ad02f4e2", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.667654Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.01112493686378, "ttft_ms": 11.85000000987202, "decode_ms": 11.756583000533283}, "total_wall_ms": 7145.507792942226, "ttft_ms": 11.85000000987202, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2952 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae74c942b2725919916b8221", "attempt_id": "786b6dceeadf", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:02.892070Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 184.76804194506258, "ttft_ms": 11.788417003117502, "decode_ms": 82.40608300548047}, "total_wall_ms": 7215.8218760741875, "ttft_ms": 11.788417003117502, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 2953 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6327d0f270950a8d968009a3", "attempt_id": "7f3d287266c7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:03.186225Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 165.31150008086115, "ttft_ms": 11.79787504952401, "decode_ms": 11.764207971282303}, "total_wall_ms": 7125.712918001227, "ttft_ms": 11.79787504952401, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2954 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "387acff2e427afe098414fcd", "attempt_id": "153b3034f20c", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:03.390365Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 452, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.54616696201265, "ttft_ms": 11.814708006568253, "decode_ms": 11.842208099551499}, "total_wall_ms": 7146.036084042862, "ttft_ms": 11.814708006568253, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2955 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2e89e7502d1437bc71263336", "attempt_id": "f89836bf53e4", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:03.614845Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6936.468709027395, "hops": {"1": 6936.468709027395}, "receiver_prefill_ms": 185.07358303759247, "ttft_ms": 11.805834015831351, "decode_ms": 11.80404203478247}, "total_wall_ms": 7145.520791993476, "ttft_ms": 11.805834015831351, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2956 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fadf6b80a3a17a3f7a9ffb6b", "attempt_id": "e2bf4ebd5cee", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:08.387120Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 165.30312492977828, "ttft_ms": 11.850125039927661, "decode_ms": 117.14154202491045}, "total_wall_ms": 11777.991416980512, "ttft_ms": 11.850125039927661, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | ||||
| 2957 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1feda63120a084bc52c6f3c", "attempt_id": "5d5d2a002589", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:08.698202Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.7597499145195, "ttft_ms": 12.01541698537767, "decode_ms": 129.88954095635563}, "total_wall_ms": 11810.371709056199, "ttft_ms": 12.01541698537767, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 2958 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "66066b99de29d4f4d57fa7c0", "attempt_id": "9636d61fa06e", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.041975Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.02974994387478, "ttft_ms": 11.894749943166971, "decode_ms": 11.993292020633817}, "total_wall_ms": 11691.599541925825, "ttft_ms": 11.894749943166971, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2959 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7e2ebc2683ad6e5785804f22", "attempt_id": "3589f293cda4", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.266158Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 164.52316695358604, "ttft_ms": 11.815292062237859, "decode_ms": 11.850083945319057}, "total_wall_ms": 11671.759251039475, "ttft_ms": 11.815292062237859, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2960 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50db5edd817167b057d9d502", "attempt_id": "92b62d67fc8f", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.470107Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.84904197975993, "ttft_ms": 11.632499983534217, "decode_ms": 11.661750031635165}, "total_wall_ms": 11691.708042053506, "ttft_ms": 11.632499983534217, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2961 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71337a6adc8a5870360ed22b", "attempt_id": "24fef414b72a", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.693550Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.38833293132484, "ttft_ms": 12.018500012345612, "decode_ms": 11.815333971753716}, "total_wall_ms": 11692.906376090832, "ttft_ms": 12.018500012345612, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2962 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "799e8a4d60036fcaf14ef86f", "attempt_id": "8057b02d18cf", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:09.918867Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 444, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 164.20979204121977, "ttft_ms": 11.923499987460673, "decode_ms": 11.82508294004947}, "total_wall_ms": 11671.63574998267, "ttft_ms": 11.923499987460673, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2963 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "abef668c0b7a6ccb6652cae4", "attempt_id": "446a113001eb", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.123429Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 164.78812508285046, "ttft_ms": 11.933541973121464, "decode_ms": 11.839375016279519}, "total_wall_ms": 11672.191416961141, "ttft_ms": 11.933541973121464, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2964 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2e1246988ad4c1c037916b9e", "attempt_id": "990405aa52e1", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.328215Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.66583306528628, "ttft_ms": 11.888416949659586, "decode_ms": 11.815374949947}, "total_wall_ms": 11693.00425099209, "ttft_ms": 11.888416949659586, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2965 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a0d4a27493151e512f10672", "attempt_id": "0bb8379b6927", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.553594Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 184.838708024472, "ttft_ms": 11.858458048664033, "decode_ms": 11.804417008534074}, "total_wall_ms": 11692.200417048298, "ttft_ms": 11.858458048664033, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2966 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "10079aa7ca414ab52eafb69e", "attempt_id": "e2ed84f5328f", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:10.777591Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 463, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.35545794293284, "ttft_ms": 11.964083067141473, "decode_ms": 11.907332926057279}, "total_wall_ms": 11692.946959054098, "ttft_ms": 11.964083067141473, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2967 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f1751334c61a6544fcf83837", "attempt_id": "570bba19f253", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.003711Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 456, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.12491695582867, "ttft_ms": 11.866500019095838, "decode_ms": 82.7463329769671}, "total_wall_ms": 11763.31404200755, "ttft_ms": 11.866500019095838, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 2968 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e89b2dcd24531c8826a8bab5", "attempt_id": "5beaba253e10", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.299335Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.42724999133497, "ttft_ms": 11.843333020806313, "decode_ms": 11.862916988320649}, "total_wall_ms": 11692.689917981625, "ttft_ms": 11.843333020806313, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2969 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fc6513c10527df06b064bcb0", "attempt_id": "818234321c94", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.523472Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.0474999519065, "ttft_ms": 11.861416045576334, "decode_ms": 11.87649997882545}, "total_wall_ms": 11692.399959079921, "ttft_ms": 11.861416045576334, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2970 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c1330581de4bcfb078be8cd3", "attempt_id": "4143f91773ab", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.748188Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11483.192084007896, "hops": {"1": 6936.468709027395, "2": 4546.723374980502}, "receiver_prefill_ms": 185.00295898411423, "ttft_ms": 11.922916048206389, "decode_ms": 11.834541917778552}, "total_wall_ms": 11692.35262600705, "ttft_ms": 11.922916048206389, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2971 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16860c18e815a31fc1d6290c", "attempt_id": "af19488cc824", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.095631Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.44495902396739, "ttft_ms": 11.853790958411992, "decode_ms": 12.021875008940697}, "total_wall_ms": 20792.664124979638, "ttft_ms": 11.853790958411992, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2972 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e1b0632f3877eef1cdeffd83", "attempt_id": "d18f86d9645f", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.300363Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 184.59491699468344, "ttft_ms": 11.866250075399876, "decode_ms": 129.9334999639541}, "total_wall_ms": 20930.726041086018, "ttft_ms": 11.866250075399876, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 2973 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad77b3a14eb57439dd764b47", "attempt_id": "2ec5efef1d5e", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.642320Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 183.82549996022135, "ttft_ms": 11.845917091704905, "decode_ms": 11.891374946571887}, "total_wall_ms": 20811.870167031884, "ttft_ms": 11.845917091704905, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2974 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50c979e2fbd85e95a0c564d8", "attempt_id": "e23e623ad151", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.865499Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.1758339246735, "ttft_ms": 11.8742500199005, "decode_ms": 11.805207934230566}, "total_wall_ms": 20792.14008396957, "ttft_ms": 11.8742500199005, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2975 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "92f883c1e23f82b06a6a65f2", "attempt_id": "d3df79261999", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.068800Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.03374990541488, "ttft_ms": 11.841833009384573, "decode_ms": 11.808292008936405}, "total_wall_ms": 20812.969458987936, "ttft_ms": 11.841833009384573, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2976 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "349cca834979b7ec2d89e18e", "attempt_id": "7ec2854dbc72", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.292678Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.4181250091642, "ttft_ms": 11.826375033706427, "decode_ms": 11.85033400543034}, "total_wall_ms": 20813.36970801931, "ttft_ms": 11.826375033706427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2977 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a447592486df7a43f7858ee0", "attempt_id": "4ad05350b006", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.516739Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 444, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.16779207065701, "ttft_ms": 11.946332990191877, "decode_ms": 11.776415980421007}, "total_wall_ms": 20792.149875080213, "ttft_ms": 11.946332990191877, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2978 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90eccaf77c9a6a72aa1e095d", "attempt_id": "ffb7e7135bf0", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.719505Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 164.6102089434862, "ttft_ms": 11.85841707047075, "decode_ms": 11.880625039339066}, "total_wall_ms": 20792.62541711796, "ttft_ms": 11.85841707047075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2979 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "936324d65d8c0a69e0195c8d", "attempt_id": "b0e05e044c09", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:22.923247Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.19008299335837, "ttft_ms": 11.860250029712915, "decode_ms": 11.795790982432663}, "total_wall_ms": 20813.140416983515, "ttft_ms": 11.860250029712915, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2980 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "73ad64ba128ba84d04f6c580", "attempt_id": "03eaa230538e", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.147509Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 184.54370903782547, "ttft_ms": 11.871750000864267, "decode_ms": 11.827250011265278}, "total_wall_ms": 20812.533666961826, "ttft_ms": 11.871750000864267, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2981 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "22dacd8f2646ee15f7da5c41", "attempt_id": "3fb733cecad0", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.371012Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 463, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.72470801882446, "ttft_ms": 11.868500034324825, "decode_ms": 11.852708994410932}, "total_wall_ms": 20813.73854202684, "ttft_ms": 11.868500034324825, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2982 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7746f175dc12b1ba6e7f3a25", "attempt_id": "2d4c8067449c", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.595542Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 456, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.0237080361694, "ttft_ms": 11.849625036120415, "decode_ms": 82.70766702480614}, "total_wall_ms": 20883.87183402665, "ttft_ms": 11.849625036120415, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 2983 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "913c805305f049c259216d9e", "attempt_id": "87891aab8478", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:23.890402Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.41999999433756, "ttft_ms": 11.828709044493735, "decode_ms": 11.834709090180695}, "total_wall_ms": 20813.37879097555, "ttft_ms": 11.828709044493735, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2984 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d478b15190aca223b51f5c76", "attempt_id": "3e5fe5dde7f6", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:24.115247Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 184.9063750123605, "ttft_ms": 11.823124950751662, "decode_ms": 11.84625003952533}, "total_wall_ms": 20812.855791067705, "ttft_ms": 11.823124950751662, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2985 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cf124bb63534ad2b693d63c7", "attempt_id": "2b5c55ab6000", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:24.338817Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20603.92000002321, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715}, "receiver_prefill_ms": 185.54220802616328, "ttft_ms": 11.914875009097159, "decode_ms": 11.851749964989722}, "total_wall_ms": 20813.61258297693, "ttft_ms": 11.914875009097159, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2986 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "27407fe5ddd3bded10c90e65", "attempt_id": "29fc9dd12987", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:42.808196Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 164.1359580680728, "ttft_ms": 11.880041914992034, "decode_ms": 11.849083006381989}, "total_wall_ms": 39032.90354204364, "ttft_ms": 11.880041914992034, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2987 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55d70990fc57abdde8c1c8d5", "attempt_id": "ae05d511537a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.012743Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 184.66995900962502, "ttft_ms": 11.843707994557917, "decode_ms": 129.85899997875094}, "total_wall_ms": 39171.41804203857, "ttft_ms": 11.843707994557917, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 2988 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "befb512ec2e1301efd8e1569", "attempt_id": "55d8bcd5417a", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.355125Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 184.86441601999104, "ttft_ms": 11.810792027972639, "decode_ms": 11.849874979816377}, "total_wall_ms": 39053.5123340087, "ttft_ms": 11.810792027972639, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2989 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "221f2a58197af486576ea3fa", "attempt_id": "7cd0aaa92bbc", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.579415Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 164.83379201963544, "ttft_ms": 11.806166963651776, "decode_ms": 11.875291005708277}, "total_wall_ms": 39033.50550006144, "ttft_ms": 11.806166963651776, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2990 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4f91af91cf769eed164604b9", "attempt_id": "754de6a6eaf6", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.783284Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.05345797166228, "ttft_ms": 11.875708936713636, "decode_ms": 12.00695801526308}, "total_wall_ms": 39053.94362506922, "ttft_ms": 11.875708936713636, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2991 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "73f47c6d5c89beeb639b5467", "attempt_id": "3471a8240b39", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.007696Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.17374992370605, "ttft_ms": 11.88095798715949, "decode_ms": 11.854749987833202}, "total_wall_ms": 39053.93200099934, "ttft_ms": 11.88095798715949, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2992 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df07df6dea0cf6065addfa76", "attempt_id": "733b36c45770", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.231889Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 444, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 164.25391589291394, "ttft_ms": 11.809166986495256, "decode_ms": 11.838875012472272}, "total_wall_ms": 39032.8872500686, "ttft_ms": 11.809166986495256, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2993 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab9e8dba7be7b85d63382125", "attempt_id": "ff1491509e5e", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.435308Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 165.02370801754296, "ttft_ms": 11.89695904031396, "decode_ms": 11.877209064550698}, "total_wall_ms": 39033.79162505735, "ttft_ms": 11.89695904031396, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2994 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "52fa2b2c3cb580da7ec91eef", "attempt_id": "92f1081e2251", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.639515Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.40212500374764, "ttft_ms": 11.866374989040196, "decode_ms": 11.911208042874932}, "total_wall_ms": 39054.18004200328, "ttft_ms": 11.866374989040196, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2995 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "70862c8c72ebe95f2f2bb9b5", "attempt_id": "6e7c77d22f4b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:44.864096Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.03620906267315, "ttft_ms": 11.9964579353109, "decode_ms": 12.023207964375615}, "total_wall_ms": 39054.06704195775, "ttft_ms": 11.9964579353109, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2996 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2dc0a964239c683b3f179055", "attempt_id": "c4b0d24a0d0b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.088682Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 463, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.9790829475969, "ttft_ms": 12.004542048089206, "decode_ms": 11.836834019050002}, "total_wall_ms": 39054.81691705063, "ttft_ms": 12.004542048089206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2997 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3caaad1c53a1ddb32a816a58", "attempt_id": "3a00a9188b29", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.313751Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 456, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.0465410389006, "ttft_ms": 11.896957992576063, "decode_ms": 82.89233292452991}, "total_wall_ms": 39124.85325103626, "ttft_ms": 11.896957992576063, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 2998 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "79fb8fd228a9c85c726bd42f", "attempt_id": "e7ec78e988b7", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.609438Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 184.29700005799532, "ttft_ms": 11.732916929759085, "decode_ms": 11.949750012718141}, "total_wall_ms": 39053.147459053434, "ttft_ms": 11.732916929759085, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2999 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c97d85eed8d58bde93d7c368", "attempt_id": "24ad152e9ec5", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.833559Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.73754199314862, "ttft_ms": 11.87799999024719, "decode_ms": 11.943457997404039}, "total_wall_ms": 39054.58787502721, "ttft_ms": 11.87799999024719, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3000 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6b0507a68f2d9d20b2279c54", "attempt_id": "38e783ff4ab5", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:46.059629Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 363, "message_utf8_bytes": 834, "cache_tensor_bytes": null, "serialized_payload_bytes": 834, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38844.63216701988, "hops": {"1": 6936.468709027395, "2": 4546.723374980502, "3": 4562.344291014597, "4": 4558.383625000715, "5": 4559.562999987975, "6": 4558.797375066206, "7": 4563.401291961782, "8": 4558.95049998071}, "receiver_prefill_ms": 185.37674995604903, "ttft_ms": 11.859874939545989, "decode_ms": 11.881249956786633}, "total_wall_ms": 39054.13695902098, "ttft_ms": 11.859874939545989, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 770}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "b7386bd5ac9c9b04a9f81a350d93a018a74bcc7cc6eb41441f5a45c9ea28d0ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3001 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecc468121b857927f149d66b", "attempt_id": "7b3835396b72", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:53.231843Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.01366699766368, "ttft_ms": 11.890541994944215, "decode_ms": 12.150709051638842}, "total_wall_ms": 7196.774625102989, "ttft_ms": 11.890541994944215, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3002 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9c81ead6074b873905fcace", "attempt_id": "36ba97098c36", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:53.499518Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.2832499584183, "ttft_ms": 11.905667022801936, "decode_ms": 12.08170794416219}, "total_wall_ms": 7196.945791016333, "ttft_ms": 11.905667022801936, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3003 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0aa9738e1cb9411ae4f12633", "attempt_id": "adf434ace87d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:53.766828Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.04312507994473, "ttft_ms": 11.928042047657073, "decode_ms": 83.2612500526011}, "total_wall_ms": 7267.958375043236, "ttft_ms": 11.928042047657073, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 3004 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b819f4cf4d70789765f56d45", "attempt_id": "72973140ba2c", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:54.104944Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 226.95950011257082, "ttft_ms": 12.000125017948449, "decode_ms": 11.916665942408144}, "total_wall_ms": 7196.552124922164, "ttft_ms": 12.000125017948449, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3005 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9aa49802748ba50ac7ef879f", "attempt_id": "ea79a43d161d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:54.371379Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.11995895951986, "ttft_ms": 11.928292107768357, "decode_ms": 107.15870803687721}, "total_wall_ms": 7291.916416957974, "ttft_ms": 11.928292107768357, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 3006 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b4e0a18d8c2966c1ad66e40e", "attempt_id": "b38a9e749d7a", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:54.733269Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.19416697509587, "ttft_ms": 11.907875072211027, "decode_ms": 11.93504105322063}, "total_wall_ms": 7196.724709006958, "ttft_ms": 11.907875072211027, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3007 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a00451a766a29b7098803d89", "attempt_id": "3727adecc409", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.000408Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 226.95954202208668, "ttft_ms": 12.039124965667725, "decode_ms": 11.90358295571059}, "total_wall_ms": 7196.595625020564, "ttft_ms": 12.039124965667725, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3008 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f2baa60c53536a3dd4482fbe", "attempt_id": "5121887d28f2", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.267121Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.23612503614277, "ttft_ms": 11.964207980781794, "decode_ms": 11.92641700617969}, "total_wall_ms": 7196.817999938503, "ttft_ms": 11.964207980781794, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3009 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e2159de9daf206c7825ef1d", "attempt_id": "6c9a6172f2ee", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.533946Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 229.46875006891787, "ttft_ms": 11.937875067815185, "decode_ms": 11.968082981184125}, "total_wall_ms": 7199.072916992009, "ttft_ms": 11.937875067815185, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3010 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1c2d6f113f606cf9fbcb401b", "attempt_id": "3b8cc8974e49", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.803170Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.52887499518692, "ttft_ms": 11.987083009444177, "decode_ms": 11.924542021006346}, "total_wall_ms": 7197.124334052205, "ttft_ms": 11.987083009444177, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3011 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "84e974276dc7ae1c7f8ac55b", "attempt_id": "0210cc9c3b1b", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.070518Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 229.18304102495313, "ttft_ms": 12.186208041384816, "decode_ms": 12.122917105443776}, "total_wall_ms": 7199.391000089236, "ttft_ms": 12.186208041384816, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3012 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "661a3cebc51120ec584eec23", "attempt_id": "9874aa566701", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.340077Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 226.54004103969783, "ttft_ms": 12.3287090100348, "decode_ms": 84.38154100440443}, "total_wall_ms": 7269.193916930817, "ttft_ms": 12.3287090100348, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 3013 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "40b645465198bd7914f472e1", "attempt_id": "800fc667bc14", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.680556Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.1463330835104, "ttft_ms": 12.037250096909702, "decode_ms": 11.95787510368973}, "total_wall_ms": 7196.986290975474, "ttft_ms": 12.037250096909702, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3014 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4182d2221720c6ea031a231d", "attempt_id": "e07e62f59299", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:56.948105Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.4645830038935, "ttft_ms": 12.003249954432249, "decode_ms": 11.94899994879961}, "total_wall_ms": 7197.1197499660775, "ttft_ms": 12.003249954432249, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3015 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7f5eccb5b99d80bd36304cc", "attempt_id": "26ab68fe59b4", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:57.215664Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6945.187625009567, "hops": {"1": 6945.187625009567}, "receiver_prefill_ms": 227.46837500017136, "ttft_ms": 11.944042053073645, "decode_ms": 11.833416996523738}, "total_wall_ms": 7196.95229199715, "ttft_ms": 11.944042053073645, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3016 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ddd0a2ed0dcb48c768ecfe32", "attempt_id": "4d72fc89187d", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.013453Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.34804202243686, "ttft_ms": 12.367833056487143, "decode_ms": 12.113792006857693}, "total_wall_ms": 13725.749083911069, "ttft_ms": 12.367833056487143, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3017 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9b17bc6001af4428d4595a97", "attempt_id": "1aafde050649", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.281307Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.9915830111131, "ttft_ms": 11.986832949332893, "decode_ms": 11.93108398001641}, "total_wall_ms": 13725.823416025378, "ttft_ms": 11.986832949332893, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3018 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ca1ccfe4498967618aac5e4c", "attempt_id": "65c3b66a4269", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.550550Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.24337503314018, "ttft_ms": 12.113417033106089, "decode_ms": 83.23362492956221}, "total_wall_ms": 13797.474874998443, "ttft_ms": 12.113417033106089, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 3019 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1495cd4007f1a99adeea5c5c", "attempt_id": "bff779179295", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:04.890664Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.6717499587685, "ttft_ms": 12.021500035189092, "decode_ms": 11.90883293747902}, "total_wall_ms": 13725.447041913867, "ttft_ms": 12.021500035189092, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3020 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "82923a9b27c5c4f3b4d0441f", "attempt_id": "ddcb031505aa", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:05.158105Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.34483401291072, "ttft_ms": 11.980792041867971, "decode_ms": 106.91137495450675}, "total_wall_ms": 13821.044415934011, "ttft_ms": 11.980792041867971, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 3021 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "de38db94279fbc7af8908fe2", "attempt_id": "5add0cc8521f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:05.520929Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.1708749467507, "ttft_ms": 11.961457901634276, "decode_ms": 11.95499999448657}, "total_wall_ms": 13725.830999901518, "ttft_ms": 11.961457901634276, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3022 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1649ac1afc6a9df21ecf9663", "attempt_id": "7aec67e491fc", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:05.788330Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.8016659654677, "ttft_ms": 12.11179094389081, "decode_ms": 11.98212499730289}, "total_wall_ms": 13725.765916984528, "ttft_ms": 12.11179094389081, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3023 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "699107816d669f7e0a3e23bf", "attempt_id": "cf01b5e3dfa8", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.055667Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.28991694748402, "ttft_ms": 11.97016704827547, "decode_ms": 11.920665972866118}, "total_wall_ms": 13725.915541988797, "ttft_ms": 11.97016704827547, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3024 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b0a2af98e6361b232020b4c4", "attempt_id": "46a607b531bf", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.323338Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 228.967540897429, "ttft_ms": 12.09699991159141, "decode_ms": 11.913041002117097}, "total_wall_ms": 13727.846957975999, "ttft_ms": 12.09699991159141, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3025 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "697645ece476866d837fffc0", "attempt_id": "99cace8fee14", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.592848Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.57745801936835, "ttft_ms": 11.894499999471009, "decode_ms": 11.974791996181011}, "total_wall_ms": 13726.162582985125, "ttft_ms": 11.894499999471009, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3026 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5ac5245051f19929cba1156", "attempt_id": "4b7586d36fe7", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:06.860923Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 229.3671660590917, "ttft_ms": 12.044333037920296, "decode_ms": 11.911208974197507}, "total_wall_ms": 13728.087250026874, "ttft_ms": 12.044333037920296, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3027 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "77d547e0da4a676a516b25c6", "attempt_id": "51a62505c708", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:07.130124Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 227.38770802970976, "ttft_ms": 11.881542042829096, "decode_ms": 118.59470896888524}, "total_wall_ms": 13832.722624996677, "ttft_ms": 11.881542042829096, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27,310,344", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "57d43335b2f7697d49fa5c54ca28131a174ade7ed50cefb8f9e04bda80bbc15f"} | ||||
| 3028 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "edfe6182ed4c363a784dd7c1", "attempt_id": "65819bfa9800", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:07.504845Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.63245897274464, "ttft_ms": 12.079125037416816, "decode_ms": 11.959875002503395}, "total_wall_ms": 13725.523082888685, "ttft_ms": 12.079125037416816, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3029 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d36780001f0d8386b12bcfac", "attempt_id": "e8e4161722b4", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:07.772870Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.955582969822, "ttft_ms": 12.005541939288378, "decode_ms": 11.948833940550685}, "total_wall_ms": 13725.715999957174, "ttft_ms": 12.005541939288378, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3030 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a217c7fd0a62d0e3230eb17", "attempt_id": "c7eec7c6324c", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:08.040485Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1498, "cache_tensor_bytes": null, "serialized_payload_bytes": 1498, "side_information_bytes": 0, "fetched_bytes": 1169, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13474.19674997218, "hops": {"1": 6945.187625009567, "2": 6529.009124962613}, "receiver_prefill_ms": 226.89295804593712, "ttft_ms": 11.957416078075767, "decode_ms": 12.158999918028712}, "total_wall_ms": 13725.748124998063, "ttft_ms": 11.957416078075767, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "dbc18f4d960624946c884bb20c9368119b30b62a2cad122ffe8ba81f0d70bc39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3031 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "379d5b5538ae30643f5249ce", "attempt_id": "4e381c78dd68", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.167322Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 208.06799991987646, "ttft_ms": 11.886875028721988, "decode_ms": 11.92337495740503}, "total_wall_ms": 25563.275250140578, "ttft_ms": 11.886875028721988, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3032 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2c7b1e8d752a7e243d1cff05", "attempt_id": "824e30cca4ae", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.416122Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.17608302645385, "ttft_ms": 11.901749996468425, "decode_ms": 12.00404204428196}, "total_wall_ms": 25565.47687505372, "ttft_ms": 11.901749996468425, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3033 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6812f7a2ba1cd68f1088eebc", "attempt_id": "74b109fd16e8", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.666282Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.53391590248793, "ttft_ms": 11.850791983306408, "decode_ms": 82.68633403349668}, "total_wall_ms": 25636.444958043285, "ttft_ms": 11.850791983306408, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 3034 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dd5d7c7d7fad46dc6f565997", "attempt_id": "7839c04733a4", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:20.986940Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 208.44499999657273, "ttft_ms": 11.90079189836979, "decode_ms": 11.803834000602365}, "total_wall_ms": 25563.497915980406, "ttft_ms": 11.90079189836979, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3035 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4904ba7a72aa51f181f35b71", "attempt_id": "f3940cc5f46a", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:21.234778Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 551, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.2336250245571, "ttft_ms": 11.869499925523996, "decode_ms": 83.0089170485735}, "total_wall_ms": 25636.500083026476, "ttft_ms": 11.869499925523996, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | ||||
| 3036 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7aff21c6616007f66536f0bc", "attempt_id": "95fa376ca579", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:21.555236Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 555, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.08454205002636, "ttft_ms": 12.00154097750783, "decode_ms": 11.829583090730011}, "total_wall_ms": 25565.407915972173, "ttft_ms": 12.00154097750783, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3037 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fbe8fa88274efe34defa866d", "attempt_id": "c91fc282df52", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:21.804851Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 544, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 208.07570801116526, "ttft_ms": 11.908499989658594, "decode_ms": 11.832666001282632}, "total_wall_ms": 25563.19179199636, "ttft_ms": 11.908499989658594, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3038 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5a9c19b242f372562c2c431", "attempt_id": "88073ca7b4d6", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.053383Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 546, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 209.97550000902265, "ttft_ms": 11.934541980735958, "decode_ms": 11.87483302783221}, "total_wall_ms": 25565.17512514256, "ttft_ms": 11.934541980735958, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3039 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "96fd33520dbff2c8001b3994", "attempt_id": "a8507bd06d42", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.303034Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 562, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.991624975577, "ttft_ms": 11.858333018608391, "decode_ms": 11.896957992576063}, "total_wall_ms": 25566.133375046775, "ttft_ms": 11.858333018608391, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3040 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c23ef4c124ac921da98151db", "attempt_id": "536dd7bb37ab", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.553423Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.20912495441735, "ttft_ms": 11.930332984775305, "decode_ms": 11.827250011265278}, "total_wall_ms": 25565.332373953424, "ttft_ms": 11.930332984775305, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3041 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36ba732ea4cfc41cc1d732ce", "attempt_id": "1e5a75f88d73", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:22.803404Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 563, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.91000002343208, "ttft_ms": 11.837874888442457, "decode_ms": 71.11466606147587}, "total_wall_ms": 25625.217791064642, "ttft_ms": 11.837874888442457, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quilun-16", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "34a7c0e11c93ba75eb4b20d3d3f5303b417856d89a232e8b16fef75c4336afc6"} | ||||
| 3042 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0b5796cbe429684200f5e2e", "attempt_id": "7371af8583c7", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.113146Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 556, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.468832985498, "ttft_ms": 11.858290992677212, "decode_ms": 118.48804203327745}, "total_wall_ms": 25672.169915982522, "ttft_ms": 11.858290992677212, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37,154,259", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "475e1c30b81f429f1ab8d86eb02313598a196f4663b8300f83f9721827c72fa2"} | ||||
| 3043 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9711e0131a0cd3d701c0574b", "attempt_id": "7b1bf9d26ee2", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.469497Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.56908403988928, "ttft_ms": 11.872458970174193, "decode_ms": 11.849624919705093}, "total_wall_ms": 25565.627333009616, "ttft_ms": 11.872458970174193, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3044 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d0b7c8d4571db28f7ac5b1e1", "attempt_id": "f50266f7a39b", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.719579Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 557, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.87249997071922, "ttft_ms": 11.962375021539629, "decode_ms": 11.809041956439614}, "total_wall_ms": 25565.994290984236, "ttft_ms": 11.962375021539629, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3045 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "adb01e79b0bbb1677e43af85", "attempt_id": "bf93f950cae7", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:23.970052Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 558, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 3507, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 25330.884958035313, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664}, "receiver_prefill_ms": 210.50145791377872, "ttft_ms": 11.901709018275142, "decode_ms": 11.903250007890165}, "total_wall_ms": 25565.673999954015, "ttft_ms": 11.901709018275142, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3046 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea9d7975f67b5aeb7c411aa4", "attempt_id": "63f6e7b49bf5", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:47.857837Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 208.17083399742842, "ttft_ms": 11.87329099047929, "decode_ms": 11.856459081172943}, "total_wall_ms": 49195.238958112895, "ttft_ms": 11.87329099047929, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3047 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4a6ccde7d05e2f611db92b53", "attempt_id": "a67b54cc6126", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.106543Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.02850006334484, "ttft_ms": 11.856041965074837, "decode_ms": 11.861832928843796}, "total_wall_ms": 49197.0619171625, "ttft_ms": 11.856041965074837, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3048 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "07212d7317ff3732c632195e", "attempt_id": "4fa869a32a56", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.356141Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 550, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 209.67208303045481, "ttft_ms": 12.14137498755008, "decode_ms": 82.86954194772989}, "total_wall_ms": 49268.13470805064, "ttft_ms": 12.14137498755008, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 3049 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36371940b36eea642b4e07dc", "attempt_id": "6cfe80fcc392", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.676719Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 545, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 208.0312919570133, "ttft_ms": 11.740374960936606, "decode_ms": 11.79654209408909}, "total_wall_ms": 49194.9811251834, "ttft_ms": 11.740374960936606, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3050 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8745caef4dfc82a81e2f64d", "attempt_id": "0604157bcc5a", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:48.924806Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 551, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 209.74558300804347, "ttft_ms": 12.021249975077808, "decode_ms": 83.20454100612551}, "total_wall_ms": 49268.38666712865, "ttft_ms": 12.021249975077808, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | ||||
| 3051 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a59db27d10289109f0328a0", "attempt_id": "88fa2190d8c9", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.247229Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 555, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.0943330442533, "ttft_ms": 12.061125016771257, "decode_ms": 11.999916983768344}, "total_wall_ms": 49197.596250101924, "ttft_ms": 12.061125016771257, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3052 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef45120307fc2266b11d8af7", "attempt_id": "825a9c93c631", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.498147Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 544, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 208.67200009524822, "ttft_ms": 11.841083061881363, "decode_ms": 11.896749958395958}, "total_wall_ms": 49195.72095805779, "ttft_ms": 11.841083061881363, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3053 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c42dad7e95de16e07f29fb97", "attempt_id": "40addd9b02ed", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.746514Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 546, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 209.4325409270823, "ttft_ms": 11.94883300922811, "decode_ms": 11.900707962922752}, "total_wall_ms": 49196.7768331524, "ttft_ms": 11.94883300922811, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3054 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f198d3f2f095fad3afbaf7f", "attempt_id": "cab9b981316d", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:49.995401Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 562, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.71041701361537, "ttft_ms": 11.958374991081655, "decode_ms": 11.919458978809416}, "total_wall_ms": 49198.026416124776, "ttft_ms": 11.958374991081655, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3055 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d4d9d8d1c6fd7c1ad0c4ed9", "attempt_id": "2f9274536f77", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:50.247543Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.1943331072107, "ttft_ms": 11.87558297533542, "decode_ms": 11.915415991097689}, "total_wall_ms": 49197.29508308228, "ttft_ms": 11.87558297533542, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3056 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df9b49b6ec627d80b0d980e4", "attempt_id": "47faad5bae03", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:50.497767Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 563, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.931958979927, "ttft_ms": 11.847249930724502, "decode_ms": 71.27329206559807}, "total_wall_ms": 49257.371041108854, "ttft_ms": 11.847249930724502, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quilun-16", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "34a7c0e11c93ba75eb4b20d3d3f5303b417856d89a232e8b16fef75c4336afc6"} | ||||
| 3057 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0745a7b15a0f41255c0e8386", "attempt_id": "a745c3d814c7", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:50.807671Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 556, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.0283340550959, "ttft_ms": 11.9330829475075, "decode_ms": 82.78916694689542}, "total_wall_ms": 49268.15895806067, "ttft_ms": 11.9330829475075, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3354484", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "5bf31ed3819d2b67352d6e22ea7f16de2ebd589c8281b4393305795b432156e3"} | ||||
| 3058 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7c25e5cad91c4ab6c6c925d0", "attempt_id": "b401e3571008", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:51.128413Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 553, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.57270793244243, "ttft_ms": 11.816957965493202, "decode_ms": 11.756874970160425}, "total_wall_ms": 49197.45633320417, "ttft_ms": 11.816957965493202, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3059 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "20b59930dcbddc00065ce674", "attempt_id": "3a1820a0b83c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:51.378907Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 557, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.54037509020418, "ttft_ms": 11.821750085800886, "decode_ms": 11.873625102452934}, "total_wall_ms": 49197.53104215488, "ttft_ms": 11.821750085800886, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3060 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c558c630043a4780c8416796", "attempt_id": "8b2e9c1fd8ce", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:51.628891Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 558, "message_tokens": 463, "message_utf8_bytes": 1435, "cache_tensor_bytes": null, "serialized_payload_bytes": 1435, "side_information_bytes": 0, "fetched_bytes": 8183, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 48962.82533311751, "hops": {"1": 6945.187625009567, "2": 6529.009124962613, "3": 5943.714833003469, "4": 5912.973375059664, "5": 5908.367124968208, "6": 5911.119500058703, "7": 5908.995958045125, "8": 5903.457792010158}, "receiver_prefill_ms": 210.47225000802428, "ttft_ms": 11.869207955896854, "decode_ms": 11.876833974383771}, "total_wall_ms": 49197.51333317254, "ttft_ms": 11.869207955896854, "input_usage": {"lookups": 14}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1498}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "4": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "5": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "6": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "7": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}, "8": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 1, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 1435}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "f946ccf31a9f007db2f33763c10d0ace160259ffb2b94381d1019bf2461c8a0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3061 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03c853b60429fefd8c52404b", "attempt_id": "f3083fa0756a", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:58.819090Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.517541998066, "ttft_ms": 11.817041086032987, "decode_ms": 11.78620895370841}, "total_wall_ms": 7127.00237496756, "ttft_ms": 11.817041086032987, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3062 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "659546d3c6c8e91434e91120", "attempt_id": "8693fef81a0f", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.024065Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.25012499187142, "ttft_ms": 11.77537499461323, "decode_ms": 129.4018329354003}, "total_wall_ms": 7245.301707996987, "ttft_ms": 11.77537499461323, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 3063 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc2dfe32753ea89d44e1cfdb", "attempt_id": "decac8927b3c", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.345970Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 163.9936660649255, "ttft_ms": 12.05391704570502, "decode_ms": 11.81683293543756}, "total_wall_ms": 7126.827500062063, "ttft_ms": 12.05391704570502, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3064 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "004f79a48f8bb5ef4b629de6", "attempt_id": "d3f7582f8d23", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.549814Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.43112504202873, "ttft_ms": 11.818542028777301, "decode_ms": 11.775457998737693}, "total_wall_ms": 7126.878416980617, "ttft_ms": 11.818542028777301, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3065 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef81e1358ba9280b1dea01fd", "attempt_id": "8f1be55433c9", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.753823Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.45770806260407, "ttft_ms": 11.775291990488768, "decode_ms": 11.769125005230308}, "total_wall_ms": 7127.935083000921, "ttft_ms": 11.775291990488768, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3066 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be1e71ee029391c89409175a", "attempt_id": "3253db3564f0", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:59.958096Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 184.9020830122754, "ttft_ms": 11.921457946300507, "decode_ms": 11.848208028823137}, "total_wall_ms": 7147.635500063188, "ttft_ms": 11.921457946300507, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3067 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "67a19ff324af232bb43044d8", "attempt_id": "717ea252564c", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.183591Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 439, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.2949590459466, "ttft_ms": 11.728540994226933, "decode_ms": 11.765125091187656}, "total_wall_ms": 7126.6367910429835, "ttft_ms": 11.728540994226933, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3068 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b75b646c7ae9de3e5b1d391", "attempt_id": "1e949e438fa2", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.387686Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 441, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 164.01404200587422, "ttft_ms": 11.757125030271709, "decode_ms": 12.009124970063567}, "total_wall_ms": 7126.621874049306, "ttft_ms": 11.757125030271709, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3069 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9764778f1bc324f5bda62993", "attempt_id": "b6d39c828995", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.590799Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.68837502971292, "ttft_ms": 11.77166705019772, "decode_ms": 11.99179096147418}, "total_wall_ms": 7148.304958012886, "ttft_ms": 11.77166705019772, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3070 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a97c4ba1dcaebb932af7be3a", "attempt_id": "c40ddb710540", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:00.815836Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.8008329104632, "ttft_ms": 11.785916984081268, "decode_ms": 82.51291699707508}, "total_wall_ms": 7198.933623963967, "ttft_ms": 11.785916984081268, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9134435", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "f7384892cb4f9a38f6115f91da5fec3f0d7e24e47877737b0f34e2b4a6af7d5a"} | ||||
| 3071 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fffda64207b098973f304634", "attempt_id": "67c02ab41338", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.091262Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.10133295785636, "ttft_ms": 11.834957986138761, "decode_ms": 11.790541000664234}, "total_wall_ms": 7147.569333086722, "ttft_ms": 11.834957986138761, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3072 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e91412e5d9c632cab392f9a9", "attempt_id": "29e2b1f997f6", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.315207Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.14366704039276, "ttft_ms": 11.891166912391782, "decode_ms": 82.28991692885756}, "total_wall_ms": 7218.1846658932045, "ttft_ms": 11.891166912391782, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 3073 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "febf4ecb58a79ecb171e348b", "attempt_id": "ee03eea820ea", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.610181Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 165.15287500806153, "ttft_ms": 11.796292033977807, "decode_ms": 11.700666975229979}, "total_wall_ms": 7127.4879990378395, "ttft_ms": 11.796292033977807, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3074 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "350140ff476429db88de04c7", "attempt_id": "23321660e55c", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.814094Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 452, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 184.93266601581126, "ttft_ms": 11.85204100329429, "decode_ms": 11.755957966670394}, "total_wall_ms": 7147.374207968824, "ttft_ms": 11.85204100329429, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3075 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ac0be4f793cfcc69f6eb9d91", "attempt_id": "560c357d500b", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:02.037931Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6938.470332999714, "hops": {"1": 6938.470332999714}, "receiver_prefill_ms": 185.35120808519423, "ttft_ms": 11.818500002846122, "decode_ms": 11.868750094436109}, "total_wall_ms": 7147.877166979015, "ttft_ms": 11.818500002846122, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3076 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "424b07858953312ca1a64299", "attempt_id": "9ee8b429de25", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:06.965140Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 164.64054200332612, "ttft_ms": 11.968332924880087, "decode_ms": 117.66037496272475}, "total_wall_ms": 11934.194498928264, "ttft_ms": 11.968332924880087, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | ||||
| 3077 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90531576983c730896a68ce8", "attempt_id": "70f45377c44e", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:07.277076Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.25383400265127, "ttft_ms": 11.858458979986608, "decode_ms": 129.4203749857843}, "total_wall_ms": 11966.401290032081, "ttft_ms": 11.858458979986608, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 3078 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751f2ecaa99dfeda54c9e58c", "attempt_id": "ce660dedb179", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:07.619905Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.57770806364715, "ttft_ms": 11.873041046783328, "decode_ms": 11.823041015304625}, "total_wall_ms": 11849.075665930286, "ttft_ms": 11.873041046783328, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3079 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ebaec1a7648c85c400d6e572", "attempt_id": "40f1875644a1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:07.844850Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 164.29262491874397, "ttft_ms": 11.786874965764582, "decode_ms": 11.796750011853874}, "total_wall_ms": 11827.676290995441, "ttft_ms": 11.786874965764582, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3080 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "81891eb09c27b34cffe6a7a9", "attempt_id": "6add956523f0", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.048199Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.66891690716147, "ttft_ms": 11.844040942378342, "decode_ms": 11.776958010159433}, "total_wall_ms": 11849.090290954337, "ttft_ms": 11.844040942378342, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3081 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c6169ee6a443339438e23875", "attempt_id": "a57ee2e3f66d", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.272554Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 459, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.2607079781592, "ttft_ms": 12.044250033795834, "decode_ms": 11.8002500385046}, "total_wall_ms": 11849.064249079674, "ttft_ms": 12.044250033795834, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3082 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0aa0f2ff17d00ee0b5b8816", "attempt_id": "b609613785cd", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.497533Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 165.24495801422745, "ttft_ms": 11.977125075645745, "decode_ms": 11.791958939284086}, "total_wall_ms": 11828.95158289466, "ttft_ms": 11.977125075645745, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3083 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e0899cf79f0f7cd52286d1f5", "attempt_id": "cc06d91f470c", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.703516Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 184.92145801428705, "ttft_ms": 11.808958952315152, "decode_ms": 11.843875050544739}, "total_wall_ms": 11848.410123959184, "ttft_ms": 11.808958952315152, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3084 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4afaca2b78a5a2420a6246ac", "attempt_id": "ed1e17cb3579", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.928038Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.9617909649387, "ttft_ms": 11.853833915665746, "decode_ms": 11.820040992461145}, "total_wall_ms": 11849.50516500976, "ttft_ms": 11.853833915665746, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3085 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "45e5d22c0f88b0f7dafad5f5", "attempt_id": "aa199fc05bbc", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.153414Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.0972919492051, "ttft_ms": 11.72175002284348, "decode_ms": 11.691333027556539}, "total_wall_ms": 11848.329706932418, "ttft_ms": 11.72175002284348, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3086 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad152b0fbec499eb226af5ba", "attempt_id": "d80390d54ed3", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.377257Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 467, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.96912501379848, "ttft_ms": 11.843541986308992, "decode_ms": 11.839832994155586}, "total_wall_ms": 11849.508290062658, "ttft_ms": 11.843541986308992, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3087 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea7dfe800281f7663543ee0e", "attempt_id": "e222ce7868c4", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.602842Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 460, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 186.07433408033103, "ttft_ms": 11.826290981844068, "decode_ms": 82.48495811130852}, "total_wall_ms": 11920.229956973344, "ttft_ms": 11.826290981844068, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 3088 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "949a8dab89a6758d64b67831", "attempt_id": "58d5af2be7cb", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.898871Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.84016605746, "ttft_ms": 11.794457910582423, "decode_ms": 11.997958994470537}, "total_wall_ms": 11849.45574903395, "ttft_ms": 11.794457910582423, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3089 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc008dc614648e16e1588613", "attempt_id": "92f96266df72", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:10.124159Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 461, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.82870799582452, "ttft_ms": 11.764083988964558, "decode_ms": 11.943458928726614}, "total_wall_ms": 11849.347415962256, "ttft_ms": 11.764083988964558, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3090 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16af9a53046028a4496ab413", "attempt_id": "28f6de5fcc12", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:10.349260Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 582, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11639.434623997658, "hops": {"1": 6938.470332999714, "2": 4700.964290997945}, "receiver_prefill_ms": 185.67920906934887, "ttft_ms": 12.047957978211343, "decode_ms": 11.850040988065302}, "total_wall_ms": 11849.513498949818, "ttft_ms": 12.047957978211343, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3091 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0e665ad4e80089ed6441be87", "attempt_id": "52c4c4ea9cc7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:19.994474Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 164.56274990923703, "ttft_ms": 11.853333096951246, "decode_ms": 117.99962492659688}, "total_wall_ms": 21351.748873945326, "ttft_ms": 11.853333096951246, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | ||||
| 3092 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2df70b38d477858500554113", "attempt_id": "57411c6174b6", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:20.305605Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 184.66441705822945, "ttft_ms": 12.011292041279376, "decode_ms": 129.9014170654118}, "total_wall_ms": 21383.978081983514, "ttft_ms": 12.011292041279376, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 3093 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0687e8c45124b05171238763", "attempt_id": "80743994c668", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:20.648131Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.12658297549933, "ttft_ms": 11.88695803284645, "decode_ms": 11.830750037916005}, "total_wall_ms": 21266.123705892824, "ttft_ms": 11.88695803284645, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3094 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a6271a37f0050d5fc481cbf1", "attempt_id": "3cfcf48721b7", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:20.872912Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 163.80154201760888, "ttft_ms": 11.907457956112921, "decode_ms": 11.8259999435395}, "total_wall_ms": 21244.801664957777, "ttft_ms": 11.907457956112921, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3095 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "43e8188e6fcbbaa714559065", "attempt_id": "5c0d580b8ef0", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.075420Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 184.74191706627607, "ttft_ms": 11.820500018075109, "decode_ms": 12.04025000333786}, "total_wall_ms": 21265.862830914557, "ttft_ms": 11.820500018075109, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3096 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9dc205e7109900d187a806d", "attempt_id": "cf0c96dcba30", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.299314Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 459, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.26295793708414, "ttft_ms": 12.03054201323539, "decode_ms": 12.195541989058256}, "total_wall_ms": 21266.860874020495, "ttft_ms": 12.03054201323539, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3097 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3ab9372f4939a85724fe460d", "attempt_id": "735ed43fda60", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.524660Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 164.92141596972942, "ttft_ms": 11.728417011909187, "decode_ms": 11.774874990805984}, "total_wall_ms": 21245.71341497358, "ttft_ms": 11.728417011909187, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3098 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5e3e1f4699c2e1eba0af4a2", "attempt_id": "de9c015cf9e1", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.729308Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 184.78320795111358, "ttft_ms": 11.876291944645345, "decode_ms": 11.811333009973168}, "total_wall_ms": 21265.739165013656, "ttft_ms": 11.876291944645345, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3099 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fc2f863d93ab99742e6425c2", "attempt_id": "c82ad5dcf1f1", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.952962Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.4307500179857, "ttft_ms": 12.07654201425612, "decode_ms": 11.884083040058613}, "total_wall_ms": 21266.66474796366, "ttft_ms": 12.07654201425612, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1baa789d177e91815ae7c290", "attempt_id": "4977b3e56415", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.177851Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.31995895318687, "ttft_ms": 11.825166991911829, "decode_ms": 11.875541997142136}, "total_wall_ms": 21266.290581901558, "ttft_ms": 11.825166991911829, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6880837c1ad977807c81a8c7", "attempt_id": "795d5a0d3d3c", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.402353Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 467, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.88358291890472, "ttft_ms": 11.947875027544796, "decode_ms": 11.9317090138793}, "total_wall_ms": 21267.132830922492, "ttft_ms": 11.947875027544796, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2901c2cc1c8400aed5c10162", "attempt_id": "7434807679c6", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.627525Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 460, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.49416703172028, "ttft_ms": 11.954375077039003, "decode_ms": 82.17991702258587}, "total_wall_ms": 21336.92470600363, "ttft_ms": 11.954375077039003, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 3103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3aa487a1dd3a5c87a1d77098", "attempt_id": "3db19c9fbe5b", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.923126Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.62016694340855, "ttft_ms": 11.85858401004225, "decode_ms": 11.833833996206522}, "total_wall_ms": 21266.592290019616, "ttft_ms": 11.85858401004225, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4442e52b34025e6a191afe2f", "attempt_id": "e81310278a02", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:23.148148Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 461, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.344333993271, "ttft_ms": 11.912125046364963, "decode_ms": 11.801417102105916}, "total_wall_ms": 21266.318249050528, "ttft_ms": 11.912125046364963, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9f045d2e63d93e8d6a99d2f", "attempt_id": "b4a5e56399cf", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:23.372326Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 1746, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 21056.896539987065, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245}, "receiver_prefill_ms": 185.00958301592618, "ttft_ms": 12.10662501398474, "decode_ms": 11.93462498486042}, "total_wall_ms": 21266.433289973065, "ttft_ms": 12.10662501398474, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8fc64bc3cad06c9588215dad", "attempt_id": "5e8695b9cc3d", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:42.448490Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 164.31158292107284, "ttft_ms": 11.830041999928653, "decode_ms": 118.30420908518136}, "total_wall_ms": 40198.22749809828, "ttft_ms": 11.830041999928653, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | ||||
| 3107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ca4383ae11ed99ab4be24fd", "attempt_id": "9f3af4dbc6ca", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:42.759966Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.30508305411786, "ttft_ms": 11.870500049553812, "decode_ms": 11.98899990413338}, "total_wall_ms": 40112.903831060976, "ttft_ms": 11.870500049553812, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d9af521fe603265dcd61405b", "attempt_id": "a4e31c2666a5", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:42.985024Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 454, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.3665839880705, "ttft_ms": 11.911417008377612, "decode_ms": 12.037124950438738}, "total_wall_ms": 40113.028290099464, "ttft_ms": 11.911417008377612, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d644cd219138f195496a6d51", "attempt_id": "8366d6394f45", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.210258Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 449, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 164.26441702060401, "ttft_ms": 11.79575000423938, "decode_ms": 11.690332903526723}, "total_wall_ms": 40091.45541500766, "ttft_ms": 11.79575000423938, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "967619c4f4f2ca8f1dcd00f8", "attempt_id": "d11cd46bc111", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.413397Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 455, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.41454209480435, "ttft_ms": 11.846874956972897, "decode_ms": 11.894208961166441}, "total_wall_ms": 40112.84574808087, "ttft_ms": 11.846874956972897, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5831b593dd59b0101bd7e0ba", "attempt_id": "1466ef0c5242", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.638039Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 459, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.5804999358952, "ttft_ms": 11.820833082310855, "decode_ms": 11.707291007041931}, "total_wall_ms": 40112.84791503567, "ttft_ms": 11.820833082310855, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "997ad129bc8fd46175b9fbb6", "attempt_id": "b60ff342f297", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:43.863054Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 163.71025005355477, "ttft_ms": 12.047083000652492, "decode_ms": 11.986915953457355}, "total_wall_ms": 40091.58279001713, "ttft_ms": 12.047083000652492, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc715339cd3a5b092ab0917c", "attempt_id": "132a9cf5c14a", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.066533Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 184.9652089877054, "ttft_ms": 11.876665987074375, "decode_ms": 11.847666930407286}, "total_wall_ms": 40112.41283197887, "ttft_ms": 11.876665987074375, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "289389570fdead364afe57cd", "attempt_id": "8215859f24aa", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.291414Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 186.13395793363452, "ttft_ms": 11.890332913026214, "decode_ms": 11.867624940350652}, "total_wall_ms": 40113.636623020284, "ttft_ms": 11.890332913026214, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1a75f72cbdf1789e1a4b0bea", "attempt_id": "7918716ca426", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.516912Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.54324994329363, "ttft_ms": 11.868958012200892, "decode_ms": 11.753374943509698}, "total_wall_ms": 40112.881915061735, "ttft_ms": 11.868958012200892, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7b3c24aefef39fcd15ed4f6b", "attempt_id": "5a8d1c87703f", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.741923Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 467, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.2469160221517, "ttft_ms": 11.851832969114184, "decode_ms": 11.884917039424181}, "total_wall_ms": 40112.6968319295, "ttft_ms": 11.851832969114184, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c1ef69fa9d14f6018e17a8a5", "attempt_id": "d62e988f09e2", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:44.966402Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 460, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.5697090504691, "ttft_ms": 11.85687503311783, "decode_ms": 82.77320803608745}, "total_wall_ms": 40183.931623003446, "ttft_ms": 11.85687503311783, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 3118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8e993e2b93f3d7d252e07ac7", "attempt_id": "9af155bbb6c5", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:45.262135Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.13104098383337, "ttft_ms": 11.781290988437831, "decode_ms": 11.864875094033778}, "total_wall_ms": 40112.47958091553, "ttft_ms": 11.781290988437831, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9802cdde1eaf14dab20233b", "attempt_id": "307bd52ae976", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:45.486687Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 461, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.66183291841298, "ttft_ms": 11.656958027742803, "decode_ms": 11.801082990132272}, "total_wall_ms": 40112.91949788574, "ttft_ms": 11.656958027742803, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "852f08d7cdd2d42c1f2c6935", "attempt_id": "e9a0318599ce", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:45.711271Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 462, "message_tokens": 367, "message_utf8_bytes": 847, "cache_tensor_bytes": null, "serialized_payload_bytes": 847, "side_information_bytes": 0, "fetched_bytes": 4074, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39903.3381229965, "hops": {"1": 6938.470332999714, "2": 4700.964290997945, "3": 4701.423165970482, "4": 4716.0387500189245, "5": 4711.475750082172, "6": 4709.1882498934865, "7": 4716.373875038698, "8": 4709.4037079950795}, "receiver_prefill_ms": 185.55879197083414, "ttft_ms": 12.172917020507157, "decode_ms": 11.823417036794126}, "total_wall_ms": 40113.387331948616, "ttft_ms": 12.172917020507157, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 783}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3cb4552bd39acfb9b1ca04c5d04cccae183051dc06ba450042dd9b360768202c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "68f50df0be63c2da43fbe79a", "attempt_id": "4db60b8ac599", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:52.884291Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.1524170646444, "ttft_ms": 11.938499985262752, "decode_ms": 11.892291018739343}, "total_wall_ms": 7196.284751058556, "ttft_ms": 11.938499985262752, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e11e0d2619d789e65d5058f3", "attempt_id": "6cfd25bdbfc0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:53.152589Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.1518340567127, "ttft_ms": 11.90512499306351, "decode_ms": 11.911417008377612}, "total_wall_ms": 7196.398084051907, "ttft_ms": 11.90512499306351, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fae165009be3b7cb6f9d6d32", "attempt_id": "219d24d19ec8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:53.420308Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.42758295498788, "ttft_ms": 11.96104206610471, "decode_ms": 83.00912496633828}, "total_wall_ms": 7267.676292103715, "ttft_ms": 11.96104206610471, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 3124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02dc215c8204ba577fbbea51", "attempt_id": "857f65976221", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:53.759086Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 226.56595904845744, "ttft_ms": 12.16012507211417, "decode_ms": 11.987749952822924}, "total_wall_ms": 7196.175834047608, "ttft_ms": 12.16012507211417, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8c511232ddd04769672c226c", "attempt_id": "68804eda82b6", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.026161Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.2182919550687, "ttft_ms": 11.998250032775104, "decode_ms": 106.68470803648233}, "total_wall_ms": 7291.227417066693, "ttft_ms": 11.998250032775104, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 3126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "00ac6ff047f1da2dba0f40f9", "attempt_id": "c52537b35467", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.388737Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.1752500673756, "ttft_ms": 12.066584080457687, "decode_ms": 12.00175005942583}, "total_wall_ms": 7196.650042082183, "ttft_ms": 12.066584080457687, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "39c502bfca2daed29daa04dc", "attempt_id": "7506e57ceb8b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.657417Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.0451249787584, "ttft_ms": 11.883500032126904, "decode_ms": 11.969916056841612}, "total_wall_ms": 7196.165043045767, "ttft_ms": 11.883500032126904, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "406514a3b1fcdf8c764b2cf5", "attempt_id": "e203d9c2cdda", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.925033Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.03204106073827, "ttft_ms": 11.973832966759801, "decode_ms": 11.963958968408406}, "total_wall_ms": 7196.251251152717, "ttft_ms": 11.973832966759801, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "34866c010d028255202e6678", "attempt_id": "1be1746ce157", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.192486Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 229.4199160533026, "ttft_ms": 11.845832923427224, "decode_ms": 11.970583000220358}, "total_wall_ms": 7198.51283414755, "ttft_ms": 11.845832923427224, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "385e7e889a365c58210ad056", "attempt_id": "2f0b0c70941d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.461693Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.41287492681295, "ttft_ms": 11.94062503054738, "decode_ms": 11.902958038263023}, "total_wall_ms": 7196.541083976626, "ttft_ms": 11.94062503054738, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "babe670b47b3449042e1dba4", "attempt_id": "c0a4dd05c363", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.728948Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 229.5377500122413, "ttft_ms": 11.927249957807362, "decode_ms": 12.015708023682237}, "total_wall_ms": 7198.722709086724, "ttft_ms": 11.927249957807362, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0dafcf322c7b111ebba73e59", "attempt_id": "9c044929c5b6", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:55.998335Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.59179095737636, "ttft_ms": 11.944000027142465, "decode_ms": 83.36770895402879}, "total_wall_ms": 7268.157125101425, "ttft_ms": 11.944000027142465, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2707654", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "7799e805760fa6568574360f61d4c7cc9e162842191ff434dfed71076922855e"} | ||||
| 3133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ce601a2052216f87b89273b", "attempt_id": "359803814e4a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:56.336875Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.23837499506772, "ttft_ms": 12.079291976988316, "decode_ms": 11.961207957938313}, "total_wall_ms": 7196.67954207398, "ttft_ms": 12.079291976988316, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71d9edf8102fdd8fa05fdfb0", "attempt_id": "dcfff703ac93", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:56.604501Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 227.17162501066923, "ttft_ms": 11.984833050519228, "decode_ms": 11.980416951701045}, "total_wall_ms": 7196.417959057726, "ttft_ms": 11.984833050519228, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e80711c1c4b49dbcdf9a792", "attempt_id": "4a51d726041c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:56.871886Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1508, "cache_tensor_bytes": null, "serialized_payload_bytes": 1508, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6944.753459072672, "hops": {"1": 6944.753459072672}, "receiver_prefill_ms": 226.47537500597537, "ttft_ms": 12.374832993373275, "decode_ms": 12.116165948100388}, "total_wall_ms": 7196.464334032498, "ttft_ms": 12.374832993373275, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "34fcc1e23e5a866b5b7d7e222f0380ba771c4005d3732e9747f026c211840d43", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b4f324d6da35d9081f7dd04a", "attempt_id": "02572e4cbbc2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:02.701137Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 559, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.97016700170934, "ttft_ms": 11.616958072409034, "decode_ms": 80.87270800024271}, "total_wall_ms": 12810.002376092598, "ttft_ms": 11.616958072409034, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-24D-4130", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "ef4c922649b61c51f72c7c8c9d9c9941a9d5c51879072478dde9d6a044f0fdc5"} | ||||
| 3137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49bbf7e6cd5b317d2dee3c10", "attempt_id": "6f549b7c583f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.022454Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 564, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.2890829341486, "ttft_ms": 11.661082971841097, "decode_ms": 11.755208019167185}, "total_wall_ms": 12741.194042144343, "ttft_ms": 11.661082971841097, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "97c4b9a4cae7feb9f4d996f6", "attempt_id": "99544a096fd0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.274132Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 564, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.0874579520896, "ttft_ms": 11.825416004285216, "decode_ms": 46.2122909957543}, "total_wall_ms": 12774.739751126617, "ttft_ms": 11.825416004285216, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 3139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5487615749e711fcdc3eb6bf", "attempt_id": "04d459727032", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.559092Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 559, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.9234170531854, "ttft_ms": 11.812791926786304, "decode_ms": 11.560500017367303}, "total_wall_ms": 12740.752417128533, "ttft_ms": 11.812791926786304, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b26fe7c0df9a4efff0c4c74", "attempt_id": "2d7916462ea4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:03.810604Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 566, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.04395906534046, "ttft_ms": 11.588540975935757, "decode_ms": 57.86379100754857}, "total_wall_ms": 12786.96691710502, "ttft_ms": 11.588540975935757, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 3141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8b9c028b74ba3f70ca5b894", "attempt_id": "5ce45c38bf17", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.108005Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 568, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.4286670004949, "ttft_ms": 11.623249971307814, "decode_ms": 11.489375028759241}, "total_wall_ms": 12740.999334026128, "ttft_ms": 11.623249971307814, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "32dc7df69e7d376f96bb6054", "attempt_id": "e4411a4ecf69", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.359303Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 559, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.47954103071243, "ttft_ms": 11.694958084262908, "decode_ms": 23.376333992928267}, "total_wall_ms": 12752.191834151745, "ttft_ms": 11.694958084262908, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f9d7762f9ac9b03675c3120e", "attempt_id": "7e3fe8f8181f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.621781Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 560, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.97699999902397, "ttft_ms": 11.56116696074605, "decode_ms": 23.316249949857593}, "total_wall_ms": 12752.484542084858, "ttft_ms": 11.56116696074605, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "649f4a52bd99f4b73bf23100", "attempt_id": "70692f9e60e7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:04.885108Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 576, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.21516700461507, "ttft_ms": 12.015625019557774, "decode_ms": 11.65220804978162}, "total_wall_ms": 12741.531834122725, "ttft_ms": 12.015625019557774, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b43245129a659e905753ecfc", "attempt_id": "1916b8d91973", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.137704Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 567, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.25241606589407, "ttft_ms": 11.684166034683585, "decode_ms": 11.535666999407113}, "total_wall_ms": 12740.972751169465, "ttft_ms": 11.684166034683585, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 3146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1527f0659f51f503c5cfa7c9", "attempt_id": "cd2354957210", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.389510Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 576, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.76787505485117, "ttft_ms": 11.658875038847327, "decode_ms": 11.655832990072668}, "total_wall_ms": 12741.532542160712, "ttft_ms": 11.658875038847327, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f82a48787694dc7a1a39bd4f", "attempt_id": "120e47cec02b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.641281Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 571, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.16933405958116, "ttft_ms": 11.637625051662326, "decode_ms": 57.92537494562566}, "total_wall_ms": 12787.278209114447, "ttft_ms": 11.637625051662326, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,085,310", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "759234a32a22ec346567fe3fddc1cee453d2284580e2c63d21796dc4d97af3f0"} | ||||
| 3148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0e7ed76be5dda33f02ba3dc8", "attempt_id": "c748e3d56eef", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:05.938877Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 567, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 211.69579098932445, "ttft_ms": 11.639332980848849, "decode_ms": 11.567125096917152}, "total_wall_ms": 12740.377584123053, "ttft_ms": 11.639332980848849, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90473dad2993e92aed0169de", "attempt_id": "b486bb8cc8e5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:06.189964Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 571, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.50716701615602, "ttft_ms": 11.632375069893897, "decode_ms": 11.580291902646422}, "total_wall_ms": 12741.362876142375, "ttft_ms": 11.632375069893897, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80b9cd275f630db236ee1cd0", "attempt_id": "d5757000dff5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:06.441617Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 573, "message_tokens": 456, "message_utf8_bytes": 1579, "cache_tensor_bytes": null, "serialized_payload_bytes": 1579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 12504.99008409679, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175}, "receiver_prefill_ms": 212.03270799014717, "ttft_ms": 11.574291973374784, "decode_ms": 11.784041998907924}, "total_wall_ms": 12740.904167061672, "ttft_ms": 11.574291973374784, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7105614ab75d6c721015e472329580cee0345d85cb536748ebca5e81e8dbca22", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d2cf26d2ac7fdf55d6d09cc2", "attempt_id": "e9d255dcf895", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.110008Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.95479193516076, "ttft_ms": 11.591459042392671, "decode_ms": 11.725915945135057}, "total_wall_ms": 24152.113250107504, "ttft_ms": 11.591459042392671, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c50016ca784113b8411cd237", "attempt_id": "a88fe76f2f5f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.359935Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.8256249446422, "ttft_ms": 11.622958001680672, "decode_ms": 11.49333396460861}, "total_wall_ms": 24151.864167070016, "ttft_ms": 11.622958001680672, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e0ca350d858a89d79fd390fe", "attempt_id": "8720f9b8db35", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.609003Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.50975001323968, "ttft_ms": 11.60995801910758, "decode_ms": 46.00933298934251}, "total_wall_ms": 24185.910208150744, "ttft_ms": 11.60995801910758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 3154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "eaf153d40e5dd83ab2253030", "attempt_id": "38b1d9b250ce", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.892280Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.6272500930354, "ttft_ms": 11.58116606529802, "decode_ms": 11.570165981538594}, "total_wall_ms": 24151.551791117527, "ttft_ms": 11.58116606529802, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4395b20aed0c24c72eb49f25", "attempt_id": "70a5f9836700", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.140476Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 521, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.93962499778718, "ttft_ms": 11.500249966047704, "decode_ms": 57.71816708147526}, "total_wall_ms": 24198.06879211683, "ttft_ms": 11.500249966047704, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 3156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0156396c92732a83f57119da", "attempt_id": "7f2b29fe2eae", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.435268Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 523, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.1938750129193, "ttft_ms": 11.526582995429635, "decode_ms": 11.78062497638166}, "total_wall_ms": 24152.32833311893, "ttft_ms": 11.526582995429635, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d48a71040ca2b766ec3dfcf3", "attempt_id": "0b2aba828063", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.684908Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.58245801739395, "ttft_ms": 11.653708992525935, "decode_ms": 22.99008402042091}, "total_wall_ms": 24162.9817080684, "ttft_ms": 11.653708992525935, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c9bc382494a3a0be370a1b8e", "attempt_id": "7d777366268d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.944599Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 515, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.60525004193187, "ttft_ms": 11.536874924786389, "decode_ms": 23.005667026154697}, "total_wall_ms": 24162.907750112936, "ttft_ms": 11.536874924786389, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "43091c788a0fb7c5874a16cc", "attempt_id": "771c5dc51338", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.204158Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.17629199195653, "ttft_ms": 11.611875030212104, "decode_ms": 11.541125015355647}, "total_wall_ms": 24152.276833192445, "ttft_ms": 11.611875030212104, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7cab3c73da43ba26f7bcfb93", "attempt_id": "4ceefbea26ee", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.452913Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.83304106630385, "ttft_ms": 11.75800000783056, "decode_ms": 11.580749996937811}, "total_wall_ms": 24152.088042115793, "ttft_ms": 11.75800000783056, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "162b350a6b5fb319bd25108c", "attempt_id": "3940956f32a5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.703231Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.2346250321716, "ttft_ms": 11.699000024236739, "decode_ms": 11.551374918781221}, "total_wall_ms": 24152.424250147305, "ttft_ms": 11.699000024236739, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1eb5af42cd4bff7c0fe3db72", "attempt_id": "f038a2d9d3ba", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:20.952821Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.15895798336715, "ttft_ms": 11.71933300793171, "decode_ms": 57.41829099133611}, "total_wall_ms": 24198.201042134315, "ttft_ms": 11.71933300793171, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,120,310", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "c4e2d208e7fb67c45a0af9f9a6d4964665fdcf54126bdc7d4d62a5c42e59adf2"} | ||||
| 3163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a5d26c83ba82f55989600b2c", "attempt_id": "4c9b6e48be4d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:21.248874Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.70904105342925, "ttft_ms": 11.660916963592172, "decode_ms": 11.569375055842102}, "total_wall_ms": 24151.899458141997, "ttft_ms": 11.660916963592172, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d203749cb9f3ead5f700a8fb", "attempt_id": "3bbb9b694eb9", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:21.498526Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 209.973624907434, "ttft_ms": 11.686792015098035, "decode_ms": 11.549124959856272}, "total_wall_ms": 24152.119250036776, "ttft_ms": 11.686792015098035, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "50b01c048336574be4196ea1", "attempt_id": "c063cd9223f8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:21.748984Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 528, "message_tokens": 411, "message_utf8_bytes": 1606, "cache_tensor_bytes": null, "serialized_payload_bytes": 1606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23918.322250130586, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444}, "receiver_prefill_ms": 210.39549994748086, "ttft_ms": 11.564792017452419, "decode_ms": 11.556208948604763}, "total_wall_ms": 24152.326250099577, "ttft_ms": 11.564792017452419, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9df441bcc254691aca50ef729117ceda7fcec91596ba108d61042763177cb3a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a53eb29c116facf1120564f", "attempt_id": "2318f6be076a", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:43.733317Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.4774170545861, "ttft_ms": 11.706708930432796, "decode_ms": 11.513833072967827}, "total_wall_ms": 45879.62020805571, "ttft_ms": 11.706708930432796, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d19a9e872122659e4354d6b1", "attempt_id": "0fa981dd2b36", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:43.982805Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.87370796501637, "ttft_ms": 11.523750028572977, "decode_ms": 11.485249968245625}, "total_wall_ms": 45879.67462395318, "ttft_ms": 11.523750028572977, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4a042778f42cc7d5dcc8b8b5", "attempt_id": "e632c4b929b4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:44.231979Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 519, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.03379102330655, "ttft_ms": 11.518332990817726, "decode_ms": 45.96875002607703}, "total_wall_ms": 45914.309291983955, "ttft_ms": 11.518332990817726, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 3169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "46afbea4c60193baf8eea7a5", "attempt_id": "319089f7e0f3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:44.515038Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.16345801763237, "ttft_ms": 11.467749951407313, "decode_ms": 11.508374940603971}, "total_wall_ms": 45879.936957964674, "ttft_ms": 11.467749951407313, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3312eb392bc296e3ac10ab47", "attempt_id": "d5f2e26ccdde", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:44.763625Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 521, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.93829099461436, "ttft_ms": 11.683167074806988, "decode_ms": 57.34379100613296}, "total_wall_ms": 45925.88841600809, "ttft_ms": 11.683167074806988, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 3171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e256a24eea71bbf4a881837b", "attempt_id": "36f2f13fcba4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.058104Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 523, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.05954209249467, "ttft_ms": 11.571915936656296, "decode_ms": 11.591000016778708}, "total_wall_ms": 45880.02587505616, "ttft_ms": 11.571915936656296, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "75d7c208ecc0cbc1720dbeff", "attempt_id": "99ba0830220b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.307632Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 514, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 208.7915410520509, "ttft_ms": 11.58149994444102, "decode_ms": 23.20962504018098}, "total_wall_ms": 45890.458708046935, "ttft_ms": 11.58149994444102, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ae6ce946411a5c966c8886a", "attempt_id": "6283746f5e33", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.566820Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 515, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.80845799203962, "ttft_ms": 11.496959021314979, "decode_ms": 23.185333935543895}, "total_wall_ms": 45891.29208307713, "ttft_ms": 11.496959021314979, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fb7a0f959b5b9d9b4c6eb180", "attempt_id": "f453d08aedb8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:45.826887Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.21349995862693, "ttft_ms": 11.583082959987223, "decode_ms": 11.523167020641267}, "total_wall_ms": 45880.12187497225, "ttft_ms": 11.583082959987223, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a3e75e7ff0bdb49ad0e315c", "attempt_id": "d27eb5a714b2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.075907Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.37204209621996, "ttft_ms": 11.538374936208129, "decode_ms": 11.743542039766908}, "total_wall_ms": 45879.43687499501, "ttft_ms": 11.538374936208129, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "369505830f6d0af79312068e", "attempt_id": "190ce7eef685", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.323965Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 531, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.2324590086937, "ttft_ms": 11.696124915033579, "decode_ms": 11.458582943305373}, "total_wall_ms": 45880.2797079552, "ttft_ms": 11.696124915033579, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2a987097d1761c6472c2cf5b", "attempt_id": "fc19e8c1e03b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.572734Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 209.68958304729313, "ttft_ms": 11.5634590620175, "decode_ms": 57.24787502549589}, "total_wall_ms": 45925.434957956895, "ttft_ms": 11.5634590620175, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,190,269", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "21023e2c5262695db33c4b4dfbf2ce40c8795742ceadf13db29509b3a088ad29"} | ||||
| 3178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef14f9fff8fa5f6f50021e7a", "attempt_id": "d425bcc14047", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:46.867226Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 522, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.1102079031989, "ttft_ms": 11.63962495047599, "decode_ms": 11.495582992210984}, "total_wall_ms": 45880.12345810421, "ttft_ms": 11.63962495047599, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "18cbbe38a8da5c961b6bd6a7", "attempt_id": "4e99f3b95af7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:47.117226Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 526, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.20649990532547, "ttft_ms": 11.656583985313773, "decode_ms": 11.594834038987756}, "total_wall_ms": 45880.25770802051, "ttft_ms": 11.656583985313773, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5282996b8e943c58145fdb3b", "attempt_id": "d438d80378fa", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:47.366819Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 528, "message_tokens": 411, "message_utf8_bytes": 1572, "cache_tensor_bytes": null, "serialized_payload_bytes": 1572, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45646.34845801629, "hops": {"1": 6944.753459072672, "2": 5560.2366250241175, "3": 6389.902791008353, "4": 5023.429375025444, "5": 5870.618999935687, "6": 5081.656874972396, "7": 5788.924874970689, "8": 4986.825458006933}, "receiver_prefill_ms": 210.3344580391422, "ttft_ms": 11.54904195573181, "decode_ms": 11.54974999371916}, "total_wall_ms": 45880.225665983744, "ttft_ms": 11.54904195573181, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1508}, "2": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1579}, "3": {"facts_total": 66, "facts_retained": 21, "retention_rate": 0.3181818181818182, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1514}, "4": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1606}, "5": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1580}, "6": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1614}, "7": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1539}, "8": {"facts_total": 66, "facts_retained": 20, "retention_rate": 0.30303030303030304, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35294117647058826, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1572}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5f91a90ae14ae9b8b6fe51726c465074152fb5d1c9595ff18bd7d10fb4e9aa4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ea68c21988e6c3e307fe98a", "attempt_id": "61760789fca4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:54.560642Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.17279106099159, "ttft_ms": 11.82345801498741, "decode_ms": 11.827292037196457}, "total_wall_ms": 7130.719625158235, "ttft_ms": 11.82345801498741, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b50913f2e4efe90df7866026", "attempt_id": "82e4e40bbb30", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:54.765287Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.5389589248225, "ttft_ms": 11.915499926544726, "decode_ms": 129.21375001315027}, "total_wall_ms": 7248.639875091612, "ttft_ms": 11.915499926544726, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 568-G in Mont-Laurier", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "98e007faa5a10742ad74f2778a64e3ea0d6b72bec1c0392200d475073d7bf082"} | ||||
| 3183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "40ff4ba3875193852fcc2869", "attempt_id": "e84b4dbfc5db", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.087199Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 445, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.58516696002334, "ttft_ms": 11.787749943323433, "decode_ms": 11.765792034566402}, "total_wall_ms": 7131.01237511728, "ttft_ms": 11.787749943323433, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cdf26439619bebeaab3e4c6e", "attempt_id": "54c0db6df4e6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.291190Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 440, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.17929204180837, "ttft_ms": 12.010416015982628, "decode_ms": 11.781290988437831}, "total_wall_ms": 7130.971959093586, "ttft_ms": 12.010416015982628, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "23b9f866e5e5c1b8cbc29935", "attempt_id": "359d82465c6e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.495093Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 446, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 165.33824999351054, "ttft_ms": 11.931874905712903, "decode_ms": 11.804083944298327}, "total_wall_ms": 7132.061625015922, "ttft_ms": 11.931874905712903, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1930788d821a20e147f1ef40", "attempt_id": "5beaf27ef6dc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.701211Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 450, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.3592919651419, "ttft_ms": 11.888915905728936, "decode_ms": 11.97108393535018}, "total_wall_ms": 7152.126542059705, "ttft_ms": 11.888915905728936, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0c0133b9c689e9d857481420", "attempt_id": "fb008591de2f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:55.926782Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 439, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.45625002961606, "ttft_ms": 11.807958013378084, "decode_ms": 11.83654204942286}, "total_wall_ms": 7130.97204209771, "ttft_ms": 11.807958013378084, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "54df357d5a8f2d4e93433bfa", "attempt_id": "4bcd26fae1b5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.130611Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 441, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.52458291314542, "ttft_ms": 11.794665944762528, "decode_ms": 11.808041017502546}, "total_wall_ms": 7130.982834030874, "ttft_ms": 11.794665944762528, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d70de1e7a817eb1353daa2a", "attempt_id": "832f12926bc9", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.334131Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 457, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.8098329976201, "ttft_ms": 11.822375003248453, "decode_ms": 11.8561249691993}, "total_wall_ms": 7152.3516670567915, "ttft_ms": 11.822375003248453, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e362aa75542bd746776f0c73", "attempt_id": "410b5f7e4587", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.558788Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 165.33612494822592, "ttft_ms": 11.832375079393387, "decode_ms": 82.35804201103747}, "total_wall_ms": 7202.369041973725, "ttft_ms": 11.832375079393387, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9134435", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "f7384892cb4f9a38f6115f91da5fec3f0d7e24e47877737b0f34e2b4a6af7d5a"} | ||||
| 3191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c98d98199120f34f8827f16d", "attempt_id": "d490e7b827d5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:56.833980Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 458, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.3366669965908, "ttft_ms": 12.078124913387, "decode_ms": 11.815457954071462}, "total_wall_ms": 7152.1960840327665, "ttft_ms": 12.078124913387, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f1663034de9f6aba686ce64", "attempt_id": "2e1ae2e964a8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.059192Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 451, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.3935410035774, "ttft_ms": 11.88008300960064, "decode_ms": 82.08512503188103}, "total_wall_ms": 7222.34874998685, "ttft_ms": 11.88008300960064, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8066734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "167c75fdd6a41fca64228797ab8f3a1a3f994475246df0bffb2e060d5d2e4ff0"} | ||||
| 3193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "04c8079f8fa3824a466c287a", "attempt_id": "d5cbd328b5ff", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.354591Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 164.56816694699228, "ttft_ms": 12.100499938242137, "decode_ms": 11.922874953597784}, "total_wall_ms": 7131.640583975241, "ttft_ms": 12.100499938242137, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "417e157d94e0e3154c9c7cd6", "attempt_id": "bd2ab830ed00", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.559883Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 452, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.2195409592241, "ttft_ms": 12.060333974659443, "decode_ms": 11.880666948854923}, "total_wall_ms": 7152.249751030467, "ttft_ms": 12.060333974659443, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b840b5a8a2bea799e19e3f8f", "attempt_id": "9a3f0b9d305d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.786959Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 2068, "query_tokens": 453, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6942.490917048417, "hops": {"1": 6942.490917048417}, "receiver_prefill_ms": 185.63199997879565, "ttft_ms": 11.94083399605006, "decode_ms": 11.851874995045364}, "total_wall_ms": 7152.419749996625, "ttft_ms": 11.94083399605006, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3c07df4f32c3dffe23905714a167378f1096d7812f8c55ff7cf92b920f04befa", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3765388b04f031b28489e005", "attempt_id": "a71aa6b7eb29", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:01.971893Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.02712496370077, "ttft_ms": 11.487290961667895, "decode_ms": 11.496416991576552}, "total_wall_ms": 11106.89208295662, "ttft_ms": 11.487290961667895, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02167f383d66e8cf77d7fdb9", "attempt_id": "3d5e86716d1f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.194376Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.27483301982284, "ttft_ms": 11.460541049018502, "decode_ms": 11.465542018413544}, "total_wall_ms": 11107.04320797231, "ttft_ms": 11.460541049018502, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f52f453ce41971920a155afc", "attempt_id": "1a4648b7f9c8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.416316Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 187.6737920101732, "ttft_ms": 11.563832988031209, "decode_ms": 11.674916953779757}, "total_wall_ms": 11111.748209106736, "ttft_ms": 11.563832988031209, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f94e6b903be994776c463660", "attempt_id": "a4e81ef944e2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.643020Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 181.05399992782623, "ttft_ms": 11.5665839985013, "decode_ms": 11.42991695087403}, "total_wall_ms": 11104.8718750244, "ttft_ms": 11.5665839985013, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2c82fa120f3bc17680c45643", "attempt_id": "a2dcd8d19210", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:02.862162Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 433, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 186.2979590659961, "ttft_ms": 11.589249945245683, "decode_ms": 11.464667040854692}, "total_wall_ms": 11110.232583014295, "ttft_ms": 11.589249945245683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3201 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b6911b723a0a6d66f439ed0", "attempt_id": "38f74865ed67", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.087265Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 435, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 188.05520795285702, "ttft_ms": 11.52770803309977, "decode_ms": 11.488832999020815}, "total_wall_ms": 11111.909626051784, "ttft_ms": 11.52770803309977, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3202 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "74408db948005691fd67cf2f", "attempt_id": "179a25fa3c47", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.314314Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 182.77116701938212, "ttft_ms": 11.77541702054441, "decode_ms": 11.436625034548342}, "total_wall_ms": 11106.801541987807, "ttft_ms": 11.77541702054441, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3203 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a46ba1327729fe935236eda5", "attempt_id": "1dded563a49c", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.535427Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 427, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.2695419434458, "ttft_ms": 11.47595897782594, "decode_ms": 11.704165954142809}, "total_wall_ms": 11107.27700102143, "ttft_ms": 11.47595897782594, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3204 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3110b0e89708c09b55470ecf", "attempt_id": "36a6c8ab9f4d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.757378Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 186.68641697149724, "ttft_ms": 11.72691595274955, "decode_ms": 11.568082962185144}, "total_wall_ms": 11110.898167011328, "ttft_ms": 11.72691595274955, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3205 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80771fd8fc01a8494cf3e917", "attempt_id": "865cf39c2408", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:03.982572Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 185.10508292820305, "ttft_ms": 11.534375022165477, "decode_ms": 11.476874933578074}, "total_wall_ms": 11108.943209052086, "ttft_ms": 11.534375022165477, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3206 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab9c0812bc1e5975c3077779", "attempt_id": "82966a7c33a8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.206904Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 184.13154198788106, "ttft_ms": 11.771833058446646, "decode_ms": 11.547999922186136}, "total_wall_ms": 11108.296750113368, "ttft_ms": 11.771833058446646, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3207 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2313839625baddfb110a28b1", "attempt_id": "9835423d86ce", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.429592Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.85466700419784, "ttft_ms": 11.49316702503711, "decode_ms": 57.294458034448326}, "total_wall_ms": 11153.48612505477, "ttft_ms": 11.49316702503711, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,066,734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "dc9cab51923d7bfcae06d683e0d005a1575296aa981b1594b358ff8e12cd8aa2"} | ||||
| 3208 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "34a7ad34fb6e6579a2a680ba", "attempt_id": "7db5b64893bb", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.697315Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 181.80583301000297, "ttft_ms": 11.380832991562784, "decode_ms": 11.359915952198207}, "total_wall_ms": 11105.435084085912, "ttft_ms": 11.380832991562784, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3209 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5cab9bb8fcc30736863eaa8a", "attempt_id": "adbce4bc2b9a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.917535Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 183.6892500286922, "ttft_ms": 11.75812492147088, "decode_ms": 11.59737491980195}, "total_wall_ms": 11108.054375974461, "ttft_ms": 11.75812492147088, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3210 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3af432d259e3bca11790a66c", "attempt_id": "0388347f07e1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:05.141625Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 440, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10900.45654203277, "hops": {"1": 6942.490917048417, "2": 3957.965624984354}, "receiver_prefill_ms": 184.25258295610547, "ttft_ms": 11.788749950937927, "decode_ms": 11.493749916553497}, "total_wall_ms": 11108.51729195565, "ttft_ms": 11.788749950937927, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3211 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6e3620e341e5f19190427c2a", "attempt_id": "c589a63df051", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.983520Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.1999579919502, "ttft_ms": 11.594541021622717, "decode_ms": 11.508165975101292}, "total_wall_ms": 19722.014916944318, "ttft_ms": 11.594541021622717, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3212 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "341398af21254299fd05432c", "attempt_id": "e87eb141ab39", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.207464Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 181.44158297218382, "ttft_ms": 11.374584049917758, "decode_ms": 11.39879203401506}, "total_wall_ms": 19718.946166918613, "ttft_ms": 11.374584049917758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3213 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ea130f623cb39142ed4abc7", "attempt_id": "426194313c55", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.427675Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 182.22395901102573, "ttft_ms": 11.67129201348871, "decode_ms": 11.588084045797586}, "total_wall_ms": 19720.284540904686, "ttft_ms": 11.67129201348871, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3214 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "483c4c81d9e0a199d7040350", "attempt_id": "fabb6e48b401", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.650090Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.7006249697879, "ttft_ms": 11.6478749550879, "decode_ms": 11.421707924455404}, "total_wall_ms": 19721.45666682627, "ttft_ms": 11.6478749550879, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3215 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ac08b5146a1444ed44eceed", "attempt_id": "739d48ad990f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:14.872852Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 433, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.29208302404732, "ttft_ms": 11.762207956053317, "decode_ms": 11.552499956451356}, "total_wall_ms": 19722.280749934725, "ttft_ms": 11.762207956053317, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3216 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5a0be8a9e3fcf17d9d150608", "attempt_id": "cdcb8c8c491c", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.096165Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 435, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.27404104638845, "ttft_ms": 11.543708038516343, "decode_ms": 11.734125087969005}, "total_wall_ms": 19721.227041911334, "ttft_ms": 11.543708038516343, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3217 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5f743a995d01fdf85b468378", "attempt_id": "e09d04d580e2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.318041Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 182.8124999301508, "ttft_ms": 11.591291055083275, "decode_ms": 11.483666021376848}, "total_wall_ms": 19720.546958851628, "ttft_ms": 11.591291055083275, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3218 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "927b79ffdb1963ca4e10d658", "attempt_id": "44aabd13aa1a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.539613Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 427, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.50520904641598, "ttft_ms": 11.576459044590592, "decode_ms": 11.547417030669749}, "total_wall_ms": 19721.285083913244, "ttft_ms": 11.576459044590592, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3219 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "57c7f9d0e47ccd7281b791a9", "attempt_id": "49e820a8cbe8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.760995Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 185.54966698866338, "ttft_ms": 11.717541958205402, "decode_ms": 11.486334027722478}, "total_wall_ms": 19723.56299997773, "ttft_ms": 11.717541958205402, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3220 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecad42e6593cb2bb3039820e", "attempt_id": "80eb3587ba88", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.984777Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.88687493279576, "ttft_ms": 11.714499909430742, "decode_ms": 11.591916088946164}, "total_wall_ms": 19721.97991691064, "ttft_ms": 11.714499909430742, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3221 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55580b0dd5cc4d278dd95af6", "attempt_id": "a2a15e8a51f4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.208789Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 183.63045796286315, "ttft_ms": 11.513874982483685, "decode_ms": 11.528540984727442}, "total_wall_ms": 19721.35595791042, "ttft_ms": 11.513874982483685, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3222 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8f08cbdd34b9bc51dbbee7b9", "attempt_id": "ee87677406ad", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.431465Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.42091590259224, "ttft_ms": 11.530417017638683, "decode_ms": 57.694667018949986}, "total_wall_ms": 19768.310999847017, "ttft_ms": 11.530417017638683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,066,734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "dc9cab51923d7bfcae06d683e0d005a1575296aa981b1594b358ff8e12cd8aa2"} | ||||
| 3223 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6a29544c45d697374848293b", "attempt_id": "6b5c885dec96", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.700159Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.90699992980808, "ttft_ms": 11.957417009398341, "decode_ms": 11.740165995433927}, "total_wall_ms": 19723.47149986308, "ttft_ms": 11.957417009398341, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3224 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "37b13692712397bfb9969bdd", "attempt_id": "4ee39ef4a927", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.924776Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 181.35991704184562, "ttft_ms": 11.548041016794741, "decode_ms": 11.508374940603971}, "total_wall_ms": 19719.093291903846, "ttft_ms": 11.548041016794741, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3225 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0c07d95ce1c0fdcfcc593ccb", "attempt_id": "15207700b686", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:17.146310Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 440, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 19514.309624908492, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781}, "receiver_prefill_ms": 184.65470790397376, "ttft_ms": 11.542166932485998, "decode_ms": 11.513334000483155}, "total_wall_ms": 19722.375583834946, "ttft_ms": 11.542166932485998, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "39e2a6f143e6938c0c3db118", "attempt_id": "09f2a992287b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:34.649674Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.08550002984703, "ttft_ms": 11.601291946135461, "decode_ms": 11.484125046990812}, "total_wall_ms": 36996.3697087951, "ttft_ms": 11.601291946135461, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "899c3af9a862ddf9b1c9041f", "attempt_id": "50e48687a91f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:34.872670Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 182.90829204488546, "ttft_ms": 11.730083962902427, "decode_ms": 11.43295899964869}, "total_wall_ms": 36996.33025098592, "ttft_ms": 11.730083962902427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b2082f56337184cddfcab15", "attempt_id": "81493b7edde7", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.094787Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 431, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.24195801001042, "ttft_ms": 11.776624945923686, "decode_ms": 11.558542028069496}, "total_wall_ms": 36998.90954291914, "ttft_ms": 11.776624945923686, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bef343ba48fd744c7b5dbff5", "attempt_id": "1d8241ac7869", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.319566Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 184.03991602826864, "ttft_ms": 11.676999973133206, "decode_ms": 11.541791958734393}, "total_wall_ms": 36997.526583843865, "ttft_ms": 11.676999973133206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "443e892f11ce691c38d53866", "attempt_id": "0e754a5883fc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.544813Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 433, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.23162510246038, "ttft_ms": 11.700915987603366, "decode_ms": 11.60245796199888}, "total_wall_ms": 36998.68741782848, "ttft_ms": 11.700915987603366, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b9c8f02f284f8c808bf7cb73", "attempt_id": "85dee5f358ed", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.768737Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 435, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 184.88633399829268, "ttft_ms": 11.612833011895418, "decode_ms": 11.551167001016438}, "total_wall_ms": 36998.181041912176, "ttft_ms": 11.612833011895418, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "31988c7fcdb04eae184ef6e0", "attempt_id": "244405cfe9ab", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:35.992030Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 426, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.257416007109, "ttft_ms": 11.537457932718098, "decode_ms": 11.523457942530513}, "total_wall_ms": 36996.444708900526, "ttft_ms": 11.537457932718098, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dd4f984fd246a4b0a43721c4", "attempt_id": "ece20b68d2c4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.213603Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 427, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.06658300571144, "ttft_ms": 11.994833941571414, "decode_ms": 11.570833972655237}, "total_wall_ms": 36996.86645891052, "ttft_ms": 11.994833941571414, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "820d76ff89aac2a575b498a1", "attempt_id": "2e04488afea4", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.435516Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.62854199949652, "ttft_ms": 11.598541983403265, "decode_ms": 11.552541982382536}, "total_wall_ms": 36996.93225091323, "ttft_ms": 11.598541983403265, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b00e6a1b7f83f6c0def836b4", "attempt_id": "a54bd0e3c2f1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.658381Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.11045794002712, "ttft_ms": 11.474458035081625, "decode_ms": 11.570999980904162}, "total_wall_ms": 36998.308541835286, "ttft_ms": 11.474458035081625, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dfcd2d188fe0e7d04babc79c", "attempt_id": "0fffbdbf5ba7", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:36.882133Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 443, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.32691604923457, "ttft_ms": 11.628582957200706, "decode_ms": 11.593833100050688}, "total_wall_ms": 36998.779916903004, "ttft_ms": 11.628582957200706, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7675354915ddcee787617f38", "attempt_id": "addda394f4c3", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.105901Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 183.45025007147342, "ttft_ms": 11.538333958014846, "decode_ms": 57.53012502100319}, "total_wall_ms": 37042.65787592158, "ttft_ms": 11.538333958014846, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,066,734", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "dc9cab51923d7bfcae06d683e0d005a1575296aa981b1594b358ff8e12cd8aa2"} | ||||
| 3238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a4702798a9616e99b3f21f59", "attempt_id": "0a5ee6adbe1f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.374216Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 434, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 182.42191604804248, "ttft_ms": 11.514583951793611, "decode_ms": 11.424958007410169}, "total_wall_ms": 36995.47787592746, "ttft_ms": 11.514583951793611, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "63bb4d730073f8a8136a1dc0", "attempt_id": "957543e372b8", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.595047Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 438, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 181.93808302748948, "ttft_ms": 12.016542023047805, "decode_ms": 11.811875039711595}, "total_wall_ms": 36996.139541850425, "ttft_ms": 12.016542023047805, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "225263431e070ab46a7e57fd", "attempt_id": "ce874528b8ff", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.816687Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1833, "query_tokens": 440, "message_tokens": 323, "message_utf8_bytes": 919, "cache_tensor_bytes": null, "serialized_payload_bytes": 919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36789.773125899956, "hops": {"1": 6942.490917048417, "2": 3957.965624984354, "3": 4647.70749991294, "4": 3966.145582962781, "5": 4663.1102920509875, "6": 3976.8799169687554, "7": 4664.292625035159, "8": 3971.1806669365615}, "receiver_prefill_ms": 185.19450002349913, "ttft_ms": 11.919625103473663, "decode_ms": 11.719666887074709}, "total_wall_ms": 36999.187958892435, "ttft_ms": 11.919625103473663, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "ledger_by_hop": {"1": {"facts_total": 66, "facts_retained": 6, "retention_rate": 0.09090909090909091, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.0, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 754}, "2": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "3": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "4": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "5": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "6": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "7": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}, "8": {"facts_total": 66, "facts_retained": 8, "retention_rate": 0.12121212121212122, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.17647058823529413, "status": 0.16666666666666666, "place": 0.16666666666666666, "identifier": 0.08333333333333333, "quantity": 0.0}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 919}}}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ec4605a52403f5abd0fa044d6604914a51692b197ccf5eac20a7175fe08f4ea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "66572425c7034fc4285d7b51", "attempt_id": "2e86bc484468", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:45.020626Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.18162497039884, "ttft_ms": 11.884292005561292, "decode_ms": 11.968541075475514}, "total_wall_ms": 7147.845167084597, "ttft_ms": 11.884292005561292, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a505875f1d4297785d2b1c75", "attempt_id": "0feb6491173b", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:45.288112Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.2848329739645, "ttft_ms": 11.879250057972968, "decode_ms": 143.36750004440546}, "total_wall_ms": 7279.33433407452, "ttft_ms": 11.879250057972968, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2e82ba4be7c3551d233bae4a", "attempt_id": "fd9ec5061d83", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:45.686474Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.71499999705702, "ttft_ms": 12.005083030089736, "decode_ms": 83.47604202572256}, "total_wall_ms": 7219.073334126733, "ttft_ms": 12.005083030089736, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2663feb6b3806e15db462141", "attempt_id": "4a68814f482c", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.024752Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.24654199555516, "ttft_ms": 11.966542107984424, "decode_ms": 107.16783395037055}, "total_wall_ms": 7243.166626081802, "ttft_ms": 11.966542107984424, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1958547f71b8ddf37f656406", "attempt_id": "1a46ec016340", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.387524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.36379189882427, "ttft_ms": 12.000042013823986, "decode_ms": 11.930583976209164}, "total_wall_ms": 7148.120459052734, "ttft_ms": 12.000042013823986, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "902f6c62c96e48069f943197", "attempt_id": "b1ccca241cdd", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.654816Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.08666697144508, "ttft_ms": 11.93825004156679, "decode_ms": 11.94079197011888}, "total_wall_ms": 7147.7413760731, "ttft_ms": 11.93825004156679, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "576887d7bdeaf2bc4e7b4398", "attempt_id": "8dca5f79eb36", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.921605Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.9028329756111, "ttft_ms": 11.929624946787953, "decode_ms": 11.902374913915992}, "total_wall_ms": 7147.443876019679, "ttft_ms": 11.929624946787953, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "de4b312c2dede396a1a34597", "attempt_id": "1f8bac3b7bd1", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:47.187621Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.014834061265, "ttft_ms": 12.189500033855438, "decode_ms": 12.008458958007395}, "total_wall_ms": 7148.10291712638, "ttft_ms": 12.189500033855438, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "af04aeaebaa092508d102f44", "attempt_id": "36e81c844352", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:47.454980Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 229.73904199898243, "ttft_ms": 11.996667017228901, "decode_ms": 83.51000002585351}, "total_wall_ms": 7222.080167150125, "ttft_ms": 11.996667017228901, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 3250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c0ee52d6b9cc2e3be3a2d06d", "attempt_id": "d2437f21e50a", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:47.796422Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.97950003203005, "ttft_ms": 11.93766703363508, "decode_ms": 107.30429191607982}, "total_wall_ms": 7242.995709064417, "ttft_ms": 11.93766703363508, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 3251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59b9ff8b13d556d357c09d32", "attempt_id": "4dd5657b5038", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:48.158347Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 229.18437502812594, "ttft_ms": 11.881874990649521, "decode_ms": 83.33941700402647}, "total_wall_ms": 7221.206209156662, "ttft_ms": 11.881874990649521, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 3252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e44219fd3fa6f41965c4458a", "attempt_id": "ad4dbca8b42d", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:48.498213Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 227.49158297665417, "ttft_ms": 11.954542016610503, "decode_ms": 119.40641701221466}, "total_wall_ms": 7255.645459052175, "ttft_ms": 11.954542016610503, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,077", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "2044d7c4afd32892ac22705680e35174db83308c139b02a1494275cc5e24aff3"} | ||||
| 3253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "94e171be9d7fba83905b3a10", "attempt_id": "406fb3f0385a", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:48.873002Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.21345799416304, "ttft_ms": 12.138666934333742, "decode_ms": 11.895625037141144}, "total_wall_ms": 7147.149959113449, "ttft_ms": 12.138666934333742, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1bf57ae1ad924ff10170ec6c", "attempt_id": "a03914bdc8b1", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:49.139135Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.58466605935246, "ttft_ms": 12.026333017274737, "decode_ms": 11.8740409379825}, "total_wall_ms": 7147.256001015194, "ttft_ms": 12.026333017274737, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8903790c81721835f22e455b", "attempt_id": "753fac8761e6", "run_group_id": "E4_core:A4|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:49.405855Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6896.277834079228, "hops": {"1": 6896.277834079228}, "receiver_prefill_ms": 226.44899995066226, "ttft_ms": 12.065957998856902, "decode_ms": 12.056792038492858}, "total_wall_ms": 7147.501792060211, "ttft_ms": 12.065957998856902, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "380461c99b1dd78a93896e5a", "attempt_id": "183d164b05e1", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:56.046438Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.353875012137, "ttft_ms": 11.964041041210294, "decode_ms": 11.987666017375886}, "total_wall_ms": 13519.761501112953, "ttft_ms": 11.964041041210294, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bb672f0d17e1dce0f73b2bfe", "attempt_id": "bc487cb70976", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:56.313252Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.6314160078764, "ttft_ms": 11.946083046495914, "decode_ms": 142.85629207734019}, "total_wall_ms": 13650.942834210582, "ttft_ms": 11.946083046495914, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2f42ac5d2c84d2ded643b7b8", "attempt_id": "1ff8956d4f1e", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:56.710422Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.8895839806646, "ttft_ms": 11.947875027544796, "decode_ms": 83.42229202389717}, "total_wall_ms": 13591.716709081084, "ttft_ms": 11.947875027544796, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "96f79ccf45bf13aa8e20f958", "attempt_id": "207e91b6d37a", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.049391Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.73004202079028, "ttft_ms": 11.906833969987929, "decode_ms": 106.80929094087332}, "total_wall_ms": 13614.928168128245, "ttft_ms": 11.906833969987929, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02be1f189f0e83e046ada8a0", "attempt_id": "67e0ed26a09d", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.410889Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.68625006917864, "ttft_ms": 12.129915994592011, "decode_ms": 11.946541024371982}, "total_wall_ms": 13520.36462619435, "ttft_ms": 12.129915994592011, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4f9b895e9fe6ba03ced05886", "attempt_id": "821443996dd8", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.678651Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.64520796388388, "ttft_ms": 12.175749987363815, "decode_ms": 12.064957991242409}, "total_wall_ms": 13520.53808409255, "ttft_ms": 12.175749987363815, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6b3ac448590ef7597cbad0e", "attempt_id": "98cb0c7a8ad5", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.946886Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.30995803046972, "ttft_ms": 12.314041960053146, "decode_ms": 12.070958036929369}, "total_wall_ms": 13520.389126148075, "ttft_ms": 12.314041960053146, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0d345796a81846aaa98c201c", "attempt_id": "46761864a207", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:58.215165Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.8997090868652, "ttft_ms": 12.095415964722633, "decode_ms": 11.946999933570623}, "total_wall_ms": 13520.565334125422, "ttft_ms": 12.095415964722633, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4bdf6b31732546e18ddc60f3", "attempt_id": "cd86d3586881", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:58.482109Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 229.23491708934307, "ttft_ms": 12.094041099771857, "decode_ms": 83.74658308457583}, "total_wall_ms": 13594.683792092837, "ttft_ms": 12.094041099771857, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 3265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2856af02e43ff323d8c69a7b", "attempt_id": "74113a5e69fa", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:58.824450Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.23045805469155, "ttft_ms": 11.929041938856244, "decode_ms": 83.53291696403176}, "total_wall_ms": 13592.285459162667, "ttft_ms": 11.929041938856244, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 3266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "541ad99c626c3a41b2c3175d", "attempt_id": "5659a2252616", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:59.163426Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 229.40008400473744, "ttft_ms": 11.954874964430928, "decode_ms": 83.58804101590067}, "total_wall_ms": 13594.433375168592, "ttft_ms": 11.954874964430928, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 3267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6f096479c1c3767ecfd79af", "attempt_id": "bedd18d26377", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:59.504837Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 226.7585409572348, "ttft_ms": 11.888833018019795, "decode_ms": 107.57604101672769}, "total_wall_ms": 13615.696668159217, "ttft_ms": 11.888833018019795, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | ||||
| 3268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03a625a270456957c9a5260d", "attempt_id": "d2753c6723dc", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:59.866982Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.17066702898592, "ttft_ms": 12.123832944780588, "decode_ms": 11.935041984543204}, "total_wall_ms": 13520.759376115166, "ttft_ms": 12.123832944780588, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "82286b4876452534535fc3f7", "attempt_id": "fc32f95bc122", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:00.134157Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.18558309134096, "ttft_ms": 11.929249973036349, "decode_ms": 11.930458946153522}, "total_wall_ms": 13520.495167118497, "ttft_ms": 11.929249973036349, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecb5609d72e2010bf8a46dd6", "attempt_id": "b3f114190f70", "run_group_id": "E4_core:A4|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:00.401203Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13268.967709154822, "hops": {"1": 6896.277834079228, "2": 6372.689875075594}, "receiver_prefill_ms": 227.34008298721164, "ttft_ms": 11.943458928726614, "decode_ms": 12.19241600483656}, "total_wall_ms": 13520.941001246683, "ttft_ms": 11.943458928726614, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ff1006e28b6f6c0c9566fe34", "attempt_id": "a51fca6b3e37", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:13.407941Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.7156249145046, "ttft_ms": 12.033959035761654, "decode_ms": 11.925957980565727}, "total_wall_ms": 26257.028710097075, "ttft_ms": 12.033959035761654, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0f34eb76b4cc9238155f6bda", "attempt_id": "53b937192b1b", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:13.675623Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.34779091458768, "ttft_ms": 12.206749990582466, "decode_ms": 142.62641698587686}, "total_wall_ms": 26387.52383517567, "ttft_ms": 12.206749990582466, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d865c8871bae28443662716e", "attempt_id": "e05e91e03c9d", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:14.073210Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.63799999281764, "ttft_ms": 11.91820902749896, "decode_ms": 82.98595796804875}, "total_wall_ms": 26327.778584207408, "ttft_ms": 11.91820902749896, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6816ded36c88edd66b898984", "attempt_id": "19c5a78e1d25", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:14.410499Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.96537501178682, "ttft_ms": 12.162000057287514, "decode_ms": 106.8377080373466}, "total_wall_ms": 26352.300918195397, "ttft_ms": 12.162000057287514, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c301dd766530faf62455a168", "attempt_id": "81b901526295", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:14.772878Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.0164160290733, "ttft_ms": 12.081584078259766, "decode_ms": 11.892499984242022}, "total_wall_ms": 26257.335210219026, "ttft_ms": 12.081584078259766, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "515b9ba7e270b411ea70bebc", "attempt_id": "22dcd59bf4de", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.040142Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.2122090216726, "ttft_ms": 11.936416034586728, "decode_ms": 12.089541996829212}, "total_wall_ms": 26257.46879214421, "ttft_ms": 11.936416034586728, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d1511681c18cdabba4457282", "attempt_id": "034bd2cbc782", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.307282Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.56787501182407, "ttft_ms": 12.073084013536572, "decode_ms": 11.860958067700267}, "total_wall_ms": 26256.818293244578, "ttft_ms": 12.073084013536572, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2ec7fa37799fc68a66dde9e2", "attempt_id": "a4a75d106f20", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.573209Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 226.69395804405212, "ttft_ms": 11.937333038076758, "decode_ms": 11.821958003565669}, "total_wall_ms": 26256.68870913796, "ttft_ms": 11.937333038076758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d27ec1b890aacecdb5689e44", "attempt_id": "9e1a0fbc23ca", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.839519Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 228.81687502376735, "ttft_ms": 12.114583048969507, "decode_ms": 83.16391706466675}, "total_wall_ms": 26330.437876167707, "ttft_ms": 12.114583048969507, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 3280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a44dbfe50a76668bb7d8098", "attempt_id": "25b5e424bc5e", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:16.179154Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.1562909008935, "ttft_ms": 11.805207934230566, "decode_ms": 82.96349993906915}, "total_wall_ms": 26328.26362620108, "ttft_ms": 11.805207934230566, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 3281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ce4a8ce342fe2b4d9d75cef4", "attempt_id": "3145a04bf5b4", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:16.517038Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 229.53029198106378, "ttft_ms": 11.93220796994865, "decode_ms": 83.03158299531788}, "total_wall_ms": 26330.745167215355, "ttft_ms": 11.93220796994865, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 3282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cf43bac325be2e3c6cdbe538", "attempt_id": "02116ce0e197", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:16.857399Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.23541699815542, "ttft_ms": 11.96366606745869, "decode_ms": 106.80866707116365}, "total_wall_ms": 26352.34383516945, "ttft_ms": 11.96366606745869, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | ||||
| 3283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cb444dc416a2807482ddba59", "attempt_id": "4bd944d4aad0", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:17.219825Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.01216698624194, "ttft_ms": 12.129625072702765, "decode_ms": 11.959999916143715}, "total_wall_ms": 26257.44529312942, "ttft_ms": 12.129625072702765, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9cd4e7c12cea665f50ab676a", "attempt_id": "6946650fb94e", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:17.487458Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.3828339530155, "ttft_ms": 12.002791976556182, "decode_ms": 11.87199994456023}, "total_wall_ms": 26257.582126068883, "ttft_ms": 12.002791976556182, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "91adf0fd87f698d5fc4ccc26", "attempt_id": "9ce3f9c45474", "run_group_id": "E4_core:A4|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:17.754665Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26005.745126167312, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415}, "receiver_prefill_ms": 227.2061250405386, "ttft_ms": 12.478624936193228, "decode_ms": 12.182833044789732}, "total_wall_ms": 26258.310334174894, "ttft_ms": 12.478624936193228, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "37df68d8055d79fbfd23563b", "attempt_id": "ca9e93fa7e21", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:43.427164Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.07891697064042, "ttft_ms": 11.851249961182475, "decode_ms": 11.946334037929773}, "total_wall_ms": 51657.05141820945, "ttft_ms": 11.851249961182475, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3fbb5dbcefb601f59b61329c", "attempt_id": "d116a2b33bc3", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:43.694527Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.05824999138713, "ttft_ms": 11.875666910782456, "decode_ms": 142.63566699810326}, "total_wall_ms": 51787.73366822861, "ttft_ms": 11.875666910782456, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5cee5fdde1034c1da3597c7c", "attempt_id": "b6cadff16730", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:44.091872Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.16091701295227, "ttft_ms": 11.90966705325991, "decode_ms": 83.14320794306695}, "total_wall_ms": 51728.349834214896, "ttft_ms": 11.90966705325991, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7258afe9605849d00393b6f2", "attempt_id": "29885195cd24", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:44.429461Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.08812507335097, "ttft_ms": 11.908416985534132, "decode_ms": 106.7351249512285}, "total_wall_ms": 51751.89341825899, "ttft_ms": 11.908416985534132, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ed83324d3a81cb598bdfe59", "attempt_id": "17cdac03bc1e", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:44.790918Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.51779097598046, "ttft_ms": 11.86512503772974, "decode_ms": 11.907125008292496}, "total_wall_ms": 51657.44196018204, "ttft_ms": 11.86512503772974, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be09b3aa2cf0ce21e167c50f", "attempt_id": "5eda559b81c8", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.057736Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.63350000604987, "ttft_ms": 11.872583068907261, "decode_ms": 11.936583905480802}, "total_wall_ms": 51657.599751255475, "ttft_ms": 11.872583068907261, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1ff9d580e18b146759c5708a", "attempt_id": "808c256cbac4", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.324773Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 226.95679205935448, "ttft_ms": 11.836083023808897, "decode_ms": 11.92099996842444}, "total_wall_ms": 51656.8319182843, "ttft_ms": 11.836083023808897, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5f0340a743fad487b3bf3c62", "attempt_id": "2423134f87ea", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.590986Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.29758301284164, "ttft_ms": 11.906791012734175, "decode_ms": 11.86133292503655}, "total_wall_ms": 51657.20420924481, "ttft_ms": 11.906791012734175, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1cb6280d20f6891b6924da71", "attempt_id": "ab8085c940ca", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:45.857087Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 229.32608297560364, "ttft_ms": 11.926500010304153, "decode_ms": 82.94041699264199}, "total_wall_ms": 51730.34229315817, "ttft_ms": 11.926500010304153, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 3295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b27be43fe49ed2b2f7c41115", "attempt_id": "dfd418fb5e0a", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.196742Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.38179203588516, "ttft_ms": 12.031542020849884, "decode_ms": 82.88679202087224}, "total_wall_ms": 51728.450918220915, "ttft_ms": 12.031542020849884, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 3296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "57775a8b8c086ba5469d6edc", "attempt_id": "a7a503e3100a", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.534662Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 229.35337503440678, "ttft_ms": 11.958708055317402, "decode_ms": 83.04466598201543}, "total_wall_ms": 51730.515543255024, "ttft_ms": 11.958708055317402, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 3297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "07f9e2f958596f66b857e98e", "attempt_id": "0f41a48e3b3f", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.874530Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 226.87454207334667, "ttft_ms": 11.904707993380725, "decode_ms": 119.04387490358204}, "total_wall_ms": 51763.96646024659, "ttft_ms": 11.904707993380725, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,777", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "3894c3c39e5c76c297dfb1859a5e1724e2454039e072357510c841bc907d01a5"} | ||||
| 3298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "edc488dc9231b9ba0fcc4ff0", "attempt_id": "ddc061e2b281", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.247702Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.00095898471773, "ttft_ms": 11.933500063605607, "decode_ms": 11.876834090799093}, "total_wall_ms": 51656.951210228726, "ttft_ms": 11.933500063605607, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7fb0d639e291adf520c80ab8", "attempt_id": "a2f2e9a8fbfe", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.514050Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 227.1774170221761, "ttft_ms": 11.896083015017211, "decode_ms": 11.803666944615543}, "total_wall_ms": 51657.00679330621, "ttft_ms": 11.896083015017211, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "78503e57a1b0783db6da36c3", "attempt_id": "2dd8e8d64a86", "run_group_id": "E4_core:A4|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.780586Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 51405.68041824736, "hops": {"1": 6896.277834079228, "2": 6372.689875075594, "3": 6377.503250027075, "4": 6359.274166985415, "5": 6348.349208012223, "6": 6350.234291981906, "7": 6348.7960420316085, "8": 6352.555750054307}, "receiver_prefill_ms": 226.98229097295552, "ttft_ms": 11.855292017571628, "decode_ms": 11.927249957807362}, "total_wall_ms": 51656.907084281556, "ttft_ms": 11.855292017571628, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dc91bf3256611aa501924736", "attempt_id": "f8fd82f647e2", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:54.929608Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 411, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 161.8083749199286, "ttft_ms": 11.755542014725506, "decode_ms": 11.817999999038875}, "total_wall_ms": 7066.811042022891, "ttft_ms": 11.755542014725506, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6cbe80d42f9714060a2991d0", "attempt_id": "8c6a5a6dbe22", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.130994Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 418, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.06329204235226, "ttft_ms": 11.834666947834194, "decode_ms": 11.84266700875014}, "total_wall_ms": 7068.1651250924915, "ttft_ms": 11.834666947834194, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b0ad1d43e019fa53ed4f0173", "attempt_id": "478a77e6a2c0", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.333579Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 417, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.7220829250291, "ttft_ms": 11.770875076763332, "decode_ms": 11.774334008805454}, "total_wall_ms": 7067.642375943251, "ttft_ms": 11.770875076763332, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "788a17db9e1537b34287249a", "attempt_id": "6631850234e7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.535125Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.14337502606213, "ttft_ms": 11.827750015072525, "decode_ms": 105.74670799542218}, "total_wall_ms": 7161.081625963561, "ttft_ms": 11.827750015072525, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9460e4679fa38b776c8c592f", "attempt_id": "5022e9728bd7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.830167Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.51045900955796, "ttft_ms": 11.79112505633384, "decode_ms": 11.737541994079947}, "total_wall_ms": 7068.429584032856, "ttft_ms": 11.79112505633384, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d7b5715c41d1321977f4f986", "attempt_id": "624a3ba78665", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.032452Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.4532919852063, "ttft_ms": 11.797582963481545, "decode_ms": 117.62612499296665}, "total_wall_ms": 7174.235957907513, "ttft_ms": 11.797582963481545, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 3307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "52c9e7d825e2534692398267", "attempt_id": "173908bff61e", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.340583Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 161.7492079967633, "ttft_ms": 11.77383295726031, "decode_ms": 11.793666984885931}, "total_wall_ms": 7066.660376032814, "ttft_ms": 11.77383295726031, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "15721e70ebc62d40ce737d3c", "attempt_id": "0b9700866239", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.541097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 413, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.26837504655123, "ttft_ms": 11.79854094516486, "decode_ms": 11.771459016017616}, "total_wall_ms": 7067.187792039476, "ttft_ms": 11.79854094516486, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5b731c948e203da928543b78", "attempt_id": "ac3bf59ea017", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:56.742292Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 164.2026249319315, "ttft_ms": 11.838082922622561, "decode_ms": 105.69224995560944}, "total_wall_ms": 7163.160209078342, "ttft_ms": 11.838082922622561, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9f91a40ae69006ed1e5cd02d", "attempt_id": "f6502e223df8", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.039446Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.7134169684723, "ttft_ms": 11.790916905738413, "decode_ms": 94.00495805311948}, "total_wall_ms": 7149.857000098564, "ttft_ms": 11.790916905738413, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | ||||
| 3311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4cf09811dbc2279993f1a833", "attempt_id": "5b7de7e763f7", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.323554Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 430, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 164.0333749819547, "ttft_ms": 11.753374943509698, "decode_ms": 11.779749998822808}, "total_wall_ms": 7068.9538340084255, "ttft_ms": 11.753374943509698, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59a500566bdd55db455ad8b4", "attempt_id": "794842ffcd57", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.526547Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.1590829929337, "ttft_ms": 11.918083066120744, "decode_ms": 82.08591700531542}, "total_wall_ms": 7138.619584031403, "ttft_ms": 11.918083066120744, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "48670f301a79e0bb5d3c71b0", "attempt_id": "e89bed80944f", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.799468Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.70604105759412, "ttft_ms": 11.711874976754189, "decode_ms": 11.718790978193283}, "total_wall_ms": 7068.602624931373, "ttft_ms": 11.711874976754189, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4646412da99cbc2f36971c9c", "attempt_id": "ef266b3c327b", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:58.002612Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 163.35641697514802, "ttft_ms": 12.127833091653883, "decode_ms": 11.905333027243614}, "total_wall_ms": 7068.938417010941, "ttft_ms": 12.127833091653883, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9d26bae2abb3869b62d84b4d", "attempt_id": "5a2f5b547565", "run_group_id": "E4_core:A5|closed|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:58.205623Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 425, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6880.990542005748, "hops": {"1": 6880.990542005748}, "receiver_prefill_ms": 162.71916695404798, "ttft_ms": 12.210833956487477, "decode_ms": 11.97233295533806}, "total_wall_ms": 7068.44333303161, "ttft_ms": 12.210833956487477, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a215fb56bdd5d9dcc24ee100", "attempt_id": "6872ee6a37c9", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.286724Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 376, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.5628749895841, "ttft_ms": 11.809916002675891, "decode_ms": 11.738666100427508}, "total_wall_ms": 10923.97341702599, "ttft_ms": 11.809916002675891, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80f81157a4dd9708955d1999", "attempt_id": "35b9f0e90c25", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.470318Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 383, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 144.05679190531373, "ttft_ms": 11.773000005632639, "decode_ms": 11.773083009757102}, "total_wall_ms": 10924.424584023654, "ttft_ms": 11.773000005632639, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3c193555e08b06c0c29574bd", "attempt_id": "84b5076b1f98", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.653790Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 382, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.37716600857675, "ttft_ms": 11.903790989890695, "decode_ms": 11.75787509419024}, "total_wall_ms": 10923.935167025775, "ttft_ms": 11.903790989890695, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a6c018aceca5a88492bcdb91", "attempt_id": "e42cad0c552b", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.837343Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.55033403262496, "ttft_ms": 11.759332963265479, "decode_ms": 105.43054109439254}, "total_wall_ms": 11017.573041957803, "ttft_ms": 11.759332963265479, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "583deff437bb60efb1b6c8f8", "attempt_id": "63ee471a94da", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.114265Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.0157919349149, "ttft_ms": 11.84691593516618, "decode_ms": 11.685207951813936}, "total_wall_ms": 10941.439876100048, "ttft_ms": 11.84691593516618, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a8f600170f94579ec9585d34", "attempt_id": "6b9c20cf7d3f", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.314364Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.33524992596358, "ttft_ms": 11.749166995286942, "decode_ms": 116.95554200559855}, "total_wall_ms": 11027.872417122126, "ttft_ms": 11.749166995286942, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 3322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc8cecc338f4d774bf3db62a", "attempt_id": "850bc39cf5ff", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.601080Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 143.05870793759823, "ttft_ms": 12.021500035189092, "decode_ms": 11.887499946169555}, "total_wall_ms": 10923.935708007775, "ttft_ms": 12.021500035189092, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cdef368123aba3a0bbe72e54", "attempt_id": "364d8e70244c", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.783684Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 378, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.8997089387849, "ttft_ms": 12.004165910184383, "decode_ms": 11.800624895840883}, "total_wall_ms": 10923.662667046301, "ttft_ms": 12.004165910184383, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6481b95b4e7bb581fbe16fe3", "attempt_id": "4236d1c6f117", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:03.968321Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 392, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.11570899374783, "ttft_ms": 12.195707997307181, "decode_ms": 106.42774996813387}, "total_wall_ms": 11036.710750078782, "ttft_ms": 12.195707997307181, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1544335c4a8e6a5ff2c7427e", "attempt_id": "27cfaf6f0bd2", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.266219Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.22429203800857, "ttft_ms": 12.08758307620883, "decode_ms": 82.41825003642589}, "total_wall_ms": 10993.69737599045, "ttft_ms": 12.08758307620883, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8edca167e09f3375bc616adf", "attempt_id": "bc297b7098fc", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.520972Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 395, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.3340419717133, "ttft_ms": 12.025582953356206, "decode_ms": 11.966958991251886}, "total_wall_ms": 10942.332791979425, "ttft_ms": 12.025582953356206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3dee557e0c4e200d2b200a6f", "attempt_id": "d4b530b0131e", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.724024Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 160.82124994136393, "ttft_ms": 12.035874999128282, "decode_ms": 82.46141695417464}, "total_wall_ms": 11012.295959051698, "ttft_ms": 12.035874999128282, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a1ba19e6806d21bca12e1e30", "attempt_id": "db44ca22e817", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.997627Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 142.9430419811979, "ttft_ms": 12.168082990683615, "decode_ms": 11.824416927993298}, "total_wall_ms": 10923.923125024885, "ttft_ms": 12.168082990683615, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "49c0f71b6f88463fac3f55ca", "attempt_id": "90543c38e07d", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:05.181995Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 160.85291700437665, "ttft_ms": 12.146541033871472, "decode_ms": 11.815583100542426}, "total_wall_ms": 10941.807334078476, "ttft_ms": 12.146541033871472, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9dbf30fd230eb6add33b7d79", "attempt_id": "08bdc60456e6", "run_group_id": "E4_core:A5|closed|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:05.385180Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 390, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10756.447292049415, "hops": {"1": 6880.990542005748, "2": 3875.456750043668}, "receiver_prefill_ms": 161.5862079197541, "ttft_ms": 11.996874934993684, "decode_ms": 11.793666053563356}, "total_wall_ms": 10942.224792088382, "ttft_ms": 11.996874934993684, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4f5d4177a9dc907602e5718c", "attempt_id": "9c75de4c2aba", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.261493Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 376, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 143.47737503703684, "ttft_ms": 11.812917073257267, "decode_ms": 11.73145801294595}, "total_wall_ms": 18594.766833935864, "ttft_ms": 11.812917073257267, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ef0d4761efbfeb625f4e83a0", "attempt_id": "800fcb539538", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.446274Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 383, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.933415947482, "ttft_ms": 11.707625002600253, "decode_ms": 11.721999966539443}, "total_wall_ms": 18593.97570893634, "ttft_ms": 11.707625002600253, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "acd7c806044d2865c211698c", "attempt_id": "09d0aa57434a", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.628620Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 382, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 143.11829104553908, "ttft_ms": 11.913125053979456, "decode_ms": 11.759917018935084}, "total_wall_ms": 18594.487750902772, "ttft_ms": 11.913125053979456, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "26e86c5173d8d85f6653ab36", "attempt_id": "889ee085ddd1", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:13.810524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.85570802167058, "ttft_ms": 11.718833004124463, "decode_ms": 105.01845797989517}, "total_wall_ms": 18687.208874849603, "ttft_ms": 11.718833004124463, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7ffaa203ef1d4b65f1d36afd", "attempt_id": "2ee3b872449e", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.085957Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 160.48441699240357, "ttft_ms": 11.946541955694556, "decode_ms": 12.141457991674542}, "total_wall_ms": 18612.320083891973, "ttft_ms": 11.946541955694556, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad4e51d3cdda20f19eaa8b88", "attempt_id": "c91a46c19aa2", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.287565Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.1923750312999, "ttft_ms": 11.8681670865044, "decode_ms": 116.82800005655736}, "total_wall_ms": 18698.578042909503, "ttft_ms": 11.8681670865044, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 3337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c668cf3ab0edfcf4abfa601b", "attempt_id": "8d70f5c596d9", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.574961Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.60345802176744, "ttft_ms": 11.67291693855077, "decode_ms": 11.709416983649135}, "total_wall_ms": 18593.607750954106, "ttft_ms": 11.67291693855077, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b51667ccdaeeb0ae4660d84", "attempt_id": "8eb52c29d750", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.756334Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 378, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 143.4065829962492, "ttft_ms": 11.7488750256598, "decode_ms": 11.724249925464392}, "total_wall_ms": 18594.483333989047, "ttft_ms": 11.7488750256598, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f4776219be502d00b1023137", "attempt_id": "5897f745b2d8", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.938340Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 392, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.03537497110665, "ttft_ms": 11.804500012658536, "decode_ms": 105.1398329436779}, "total_wall_ms": 18705.592874903232, "ttft_ms": 11.804500012658536, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1b6ef64ee6a56ca1233d7517", "attempt_id": "02efce2f7fe0", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.231234Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.64912507496774, "ttft_ms": 11.904458049684763, "decode_ms": 81.76762494258583}, "total_wall_ms": 18663.90858392697, "ttft_ms": 11.904458049684763, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "196de3234c02bae78e1c224e", "attempt_id": "90583394cd53", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.482626Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 395, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.09754191711545, "ttft_ms": 11.719250003807247, "decode_ms": 11.691750027239323}, "total_wall_ms": 18612.112749833614, "ttft_ms": 11.719250003807247, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae88c3e3f1a5578f7a126f8f", "attempt_id": "11cfa484a26b", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.682528Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 160.5674580205232, "ttft_ms": 11.716125067323446, "decode_ms": 81.88541699200869}, "total_wall_ms": 18681.780041893944, "ttft_ms": 11.716125067323446, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ddd746d82af591115750f48f", "attempt_id": "e072aa26f2ad", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:15.952026Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 142.90795801207423, "ttft_ms": 11.818624916486442, "decode_ms": 11.799416039139032}, "total_wall_ms": 18594.124916940928, "ttft_ms": 11.818624916486442, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ce8bd9c159c29e14f8bf882d", "attempt_id": "e1ccebf41b6f", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:16.133793Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.0071249306202, "ttft_ms": 11.830665986053646, "decode_ms": 11.767374933697283}, "total_wall_ms": 18612.18333384022, "ttft_ms": 11.830665986053646, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fc70f0d4f80b35e40c9b8113", "attempt_id": "77a828a66882", "run_group_id": "E4_core:A5|closed|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:16.333405Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 390, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18427.254083915614, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443}, "receiver_prefill_ms": 161.34524997323751, "ttft_ms": 11.964292032644153, "decode_ms": 11.853417032398283}, "total_wall_ms": 18612.765374942683, "ttft_ms": 11.964292032644153, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b173341cbe379c0d0a7b28b3", "attempt_id": "d975d197e761", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:31.882605Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 376, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.2176660746336, "ttft_ms": 11.783457943238318, "decode_ms": 11.821625055745244}, "total_wall_ms": 33938.74595896341, "ttft_ms": 11.783457943238318, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "44220c9c7d7054b6eaf60f0c", "attempt_id": "940c762f4e53", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.065894Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 383, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.8692919909954, "ttft_ms": 11.777416919358075, "decode_ms": 11.827833019196987}, "total_wall_ms": 33939.367875806056, "ttft_ms": 11.777416919358075, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "86f81738fcaa1956a8116c38", "attempt_id": "e3b7dddcba8e", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.249212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 382, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.66883295588195, "ttft_ms": 11.724208015948534, "decode_ms": 12.064500013366342}, "total_wall_ms": 33939.35116683133, "ttft_ms": 11.724208015948534, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a8f9525849fb21de402671dc", "attempt_id": "c8d0a59299ba", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.432388Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.6260410118848, "ttft_ms": 11.769667034968734, "decode_ms": 106.04074993170798}, "total_wall_ms": 34033.34854298737, "ttft_ms": 11.769667034968734, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "beae63f4a02dac2ef15d56ca", "attempt_id": "10b189f7899b", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.709415Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.79454205464572, "ttft_ms": 11.829916038550436, "decode_ms": 11.93750009406358}, "total_wall_ms": 33956.46762591787, "ttft_ms": 11.829916038550436, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dd92271a33962db624b25f6b", "attempt_id": "1484da0a2689", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:32.909683Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.5096249440685, "ttft_ms": 11.806208989582956, "decode_ms": 118.01516695413738}, "total_wall_ms": 34044.2333339015, "ttft_ms": 11.806208989582956, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 3352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ce8546e294d327883c78944", "attempt_id": "f1521c6475b2", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.197715Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 377, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 143.50408292375505, "ttft_ms": 11.811125092208385, "decode_ms": 11.785084032453597}, "total_wall_ms": 33938.9966679737, "ttft_ms": 11.811125092208385, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "14e2316bae62e3150e5da7ed", "attempt_id": "f22028da1af3", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.380636Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 378, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.95812498312443, "ttft_ms": 11.813041986897588, "decode_ms": 11.816457961685956}, "total_wall_ms": 33938.47612594254, "ttft_ms": 11.813041986897588, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "190ff5864d9c0a9fa6431bc6", "attempt_id": "af2a960bdb29", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.562613Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 392, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 161.10620892141014, "ttft_ms": 11.814457946456969, "decode_ms": 105.62295897398144}, "total_wall_ms": 34050.455209915526, "ttft_ms": 11.814457946456969, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "78b59f8fc9ce016fc86219b8", "attempt_id": "536c3afe262c", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.856274Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.65770895872265, "ttft_ms": 11.740584042854607, "decode_ms": 81.82291698176414}, "total_wall_ms": 34008.11458390672, "ttft_ms": 11.740584042854607, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8d16664747a264fac994528e", "attempt_id": "6aada17c4c14", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.108050Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 395, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.55770800448954, "ttft_ms": 11.701749986968935, "decode_ms": 11.696540983393788}, "total_wall_ms": 33955.845542950556, "ttft_ms": 11.701749986968935, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f66ab10c7154687f9b902c04", "attempt_id": "3f680ff9bd41", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.307316Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.3999580256641, "ttft_ms": 11.728040990419686, "decode_ms": 81.81229105684906}, "total_wall_ms": 34025.84295999259, "ttft_ms": 11.728040990419686, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8d705cddf11cf741f5df60e0", "attempt_id": "d0314846e27e", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.576471Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 385, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 142.28320808615535, "ttft_ms": 11.696208966895938, "decode_ms": 11.715666973032057}, "total_wall_ms": 33937.57891689893, "ttft_ms": 11.696208966895938, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0d319a0a906287feb1d2ce9", "attempt_id": "f7535372e763", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.757606Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 388, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.82045796792954, "ttft_ms": 11.703249998390675, "decode_ms": 11.678499984554946}, "total_wall_ms": 33956.093625864014, "ttft_ms": 11.703249998390675, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d3eaf196ab4168c641de924", "attempt_id": "553728977050", "run_group_id": "E4_core:A5|closed|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.957283Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 390, "message_tokens": 294, "message_utf8_bytes": 736, "cache_tensor_bytes": null, "serialized_payload_bytes": 736, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 33771.53900091071, "hops": {"1": 6880.990542005748, "2": 3875.456750043668, "3": 3842.124249902554, "4": 3828.6825419636443, "5": 3843.770332983695, "6": 3833.0124999629334, "7": 3827.791125047952, "8": 3839.710959000513}, "receiver_prefill_ms": 160.95841699279845, "ttft_ms": 11.682874988764524, "decode_ms": 11.715583968907595}, "total_wall_ms": 33956.26037591137, "ttft_ms": 11.682874988764524, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "3": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "4": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "5": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "6": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "7": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}, "8": {"facts_total": 63, "facts_retained": 8, "retention_rate": 0.12698412698412698, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 696}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "5de8bbf0fdf02bbceb67207371e6f5c0ec86d2b30877ec832e254d4b22f40895", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6e6fd989c552471cceede09d", "attempt_id": "0c3d90351834", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:42.072957Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 225.96166701987386, "ttft_ms": 12.14233401697129, "decode_ms": 12.142083025537431}, "total_wall_ms": 7164.618417038582, "ttft_ms": 12.14233401697129, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b985e7ee755f590f19dd7ced", "attempt_id": "1f364c6119a6", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:42.340858Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.10537498258054, "ttft_ms": 12.183125014416873, "decode_ms": 143.83104199077934}, "total_wall_ms": 7296.495040995069, "ttft_ms": 12.183125014416873, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "548a8796c91c2ecf2521bbd7", "attempt_id": "5e01c238a318", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:42.740299Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.22108296491206, "ttft_ms": 12.253916938789189, "decode_ms": 84.06479202676564}, "total_wall_ms": 7236.934624030255, "ttft_ms": 12.253916938789189, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "39c511551d0929cbd8c30526", "attempt_id": "9aa07bc3c245", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.080421Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.4239169890061, "ttft_ms": 12.130500050261617, "decode_ms": 107.62237501330674}, "total_wall_ms": 7260.570583050139, "ttft_ms": 12.130500050261617, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6b2b4122f63542287d3f9fba", "attempt_id": "7471bc7cb223", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.444163Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.8315830733627, "ttft_ms": 12.146459077484906, "decode_ms": 11.996458051726222}, "total_wall_ms": 7165.376124088652, "ttft_ms": 12.146459077484906, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a1bb68080696d7ada6bcc03", "attempt_id": "15265438a15d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.713002Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.76500002853572, "ttft_ms": 12.177166994661093, "decode_ms": 11.972832959145308}, "total_wall_ms": 7165.297083090991, "ttft_ms": 12.177166994661093, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9e4325b1939b80f9c577f774", "attempt_id": "29f482ef35a7", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:43.981236Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.59629094414413, "ttft_ms": 12.120499974116683, "decode_ms": 11.998625006526709}, "total_wall_ms": 7165.1322490070015, "ttft_ms": 12.120499974116683, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "327c40a35449264958ac7ec0", "attempt_id": "f6ffd1b7f38b", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:44.249810Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.79187497124076, "ttft_ms": 12.165124993771315, "decode_ms": 11.956791044212878}, "total_wall_ms": 7165.306583046913, "ttft_ms": 12.165124993771315, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "62ad7b40251cf5a894e0e5f5", "attempt_id": "f599a6e76ed3", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:44.519082Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 229.277583071962, "ttft_ms": 12.159582925960422, "decode_ms": 84.08250007778406}, "total_wall_ms": 7239.922000095248, "ttft_ms": 12.159582925960422, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 3370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "757649df8e9bbc3b12bc3ed2", "attempt_id": "e0ea438959ef", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:44.862223Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.67512495536357, "ttft_ms": 12.085333000868559, "decode_ms": 107.8914999961853}, "total_wall_ms": 7261.088541010395, "ttft_ms": 12.085333000868559, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 3371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bdcbc28dec2dfaa66c061550", "attempt_id": "72a15ea591a0", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.226549Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 228.9500420447439, "ttft_ms": 12.183125014416873, "decode_ms": 83.30258296336979}, "total_wall_ms": 7238.800166058354, "ttft_ms": 12.183125014416873, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 3372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b6d5f31a9df67f6e222bc2ae", "attempt_id": "d538ccfd6487", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.568474Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.82812495622784, "ttft_ms": 12.169958092272282, "decode_ms": 118.85733297094703}, "total_wall_ms": 7272.266249055974, "ttft_ms": 12.169958092272282, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,077", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "2044d7c4afd32892ac22705680e35174db83308c139b02a1494275cc5e24aff3"} | ||||
| 3373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b9a6db463aabbfd242e621b6", "attempt_id": "b3d8766da95d", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.943582Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.58933291677386, "ttft_ms": 12.23166601266712, "decode_ms": 12.016292079351842}, "total_wall_ms": 7165.241083013825, "ttft_ms": 12.23166601266712, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "64a3724f1f53f0a670e85247", "attempt_id": "11b0e4adb5b3", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:46.212212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 227.10920800454915, "ttft_ms": 12.291125021874905, "decode_ms": 12.066417024470866}, "total_wall_ms": 7165.863624075428, "ttft_ms": 12.291125021874905, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9cef6c4a91ca520c14ebc0fc", "attempt_id": "146173a7e154", "run_group_id": "E4_core:A4|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:46.481119Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6913.723333040252, "hops": {"1": 6913.723333040252}, "receiver_prefill_ms": 226.86308296397328, "ttft_ms": 12.225582962855697, "decode_ms": 12.079791980795562}, "total_wall_ms": 7165.599124040455, "ttft_ms": 12.225582962855697, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df0dbdc3889b2a6c345d19f2", "attempt_id": "350b58766205", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:53.289390Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.35254205670208, "ttft_ms": 12.28716701734811, "decode_ms": 12.075082981027663}, "total_wall_ms": 13702.642832999118, "ttft_ms": 12.28716701734811, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5cf7b6c029ac4818104d7115", "attempt_id": "a6d7f037b37e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:53.558294Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.64000000804663, "ttft_ms": 12.293500010855496, "decode_ms": 143.57829198706895}, "total_wall_ms": 13834.429916925728, "ttft_ms": 12.293500010855496, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "08a8bc058ab123854ed02cdc", "attempt_id": "b9ab57669002", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:53.958453Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.69533302541822, "ttft_ms": 12.066500028595328, "decode_ms": 83.11524998862296}, "total_wall_ms": 13773.747792001814, "ttft_ms": 12.066500028595328, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d08ecc1335c91e9ce6267148", "attempt_id": "726638d270fd", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:54.297839Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.5240829437971, "ttft_ms": 11.990500031970441, "decode_ms": 106.53254191856831}, "total_wall_ms": 13796.93720897194, "ttft_ms": 11.990500031970441, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b06892989a5155729f89fa32", "attempt_id": "5f63ac8f803c", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:54.660596Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.84458293952048, "ttft_ms": 12.060915934853256, "decode_ms": 11.918332893401384}, "total_wall_ms": 13702.739875065163, "ttft_ms": 12.060915934853256, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fff346f880d82842e6b4cbea", "attempt_id": "0dc009303f2f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:54.929017Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.62308299914002, "ttft_ms": 12.006666045635939, "decode_ms": 11.951415915973485}, "total_wall_ms": 13702.495709061623, "ttft_ms": 12.006666045635939, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d62e55029a0ba2cd7e09c719", "attempt_id": "41e92ce0fe55", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:55.197097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.68587497901171, "ttft_ms": 11.990415980108082, "decode_ms": 11.908792075701058}, "total_wall_ms": 13702.452500117943, "ttft_ms": 11.990415980108082, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6da39d4d588b902897721ebe", "attempt_id": "7c8707a7d761", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:55.465343Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.7853330122307, "ttft_ms": 11.99666690081358, "decode_ms": 11.910333065316081}, "total_wall_ms": 13702.584250015207, "ttft_ms": 11.99666690081358, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a83ba17574baa40d711dab88", "attempt_id": "0c93cab1f249", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:55.733341Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 228.2851659692824, "ttft_ms": 12.088999967090786, "decode_ms": 83.26541702263057}, "total_wall_ms": 13775.558584020473, "ttft_ms": 12.088999967090786, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 3385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "33c1495d050ae225bec74528", "attempt_id": "041173017e3f", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:56.074276Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.19133302941918, "ttft_ms": 12.269999948330224, "decode_ms": 82.75495795533061}, "total_wall_ms": 13773.125833948143, "ttft_ms": 12.269999948330224, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 3386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7cdc4b421e72469d18bd94f", "attempt_id": "394a75b23025", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:56.412546Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 228.50770794320852, "ttft_ms": 12.111791060306132, "decode_ms": 82.78241602238268}, "total_wall_ms": 13775.284833973274, "ttft_ms": 12.111791060306132, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 3387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d9de66d05b9d383c900d69a5", "attempt_id": "3c26a3fa35cb", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:56.753059Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.88262502197176, "ttft_ms": 12.022458016872406, "decode_ms": 106.70112492516637}, "total_wall_ms": 13797.50537511427, "ttft_ms": 12.022458016872406, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | ||||
| 3388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "57b4ec7e0d27a3d7fc0cf8e4", "attempt_id": "02b853b2d02e", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:57.115881Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.58875002525747, "ttft_ms": 12.043667025864124, "decode_ms": 11.88120897859335}, "total_wall_ms": 13702.396042062901, "ttft_ms": 12.043667025864124, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b696778534835305efdbfb84", "attempt_id": "5f15c6112c61", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:57.383842Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 226.85708303470165, "ttft_ms": 12.016250053420663, "decode_ms": 11.925583006814122}, "total_wall_ms": 13702.708334079944, "ttft_ms": 12.016250053420663, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0a76d42e6f7af180e2ae75f9", "attempt_id": "1ea029929a79", "run_group_id": "E4_core:A4|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:57.652009Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 854, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 13451.244542025961, "hops": {"1": 6913.723333040252, "2": 6537.521208985709}, "receiver_prefill_ms": 227.03512501902878, "ttft_ms": 12.07654201425612, "decode_ms": 11.895833071321249}, "total_wall_ms": 13702.917042071931, "ttft_ms": 12.07654201425612, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d9edfad527989a186700f618", "attempt_id": "9ab32be73dd6", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:10.898438Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.20100004132837, "ttft_ms": 12.043249909766018, "decode_ms": 11.869083042256534}, "total_wall_ms": 26676.909374888055, "ttft_ms": 12.043249909766018, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89cc6c4231d348a92ae1c360", "attempt_id": "554978bdb979", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:11.166060Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.74266702961177, "ttft_ms": 12.103458982892334, "decode_ms": 142.3419580096379}, "total_wall_ms": 26807.97545891255, "ttft_ms": 12.103458982892334, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7cb051c1c46a0bcf7a727733", "attempt_id": "1aa4eb2e9bf4", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:11.564427Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.67437500786036, "ttft_ms": 11.96850009728223, "decode_ms": 84.03270808048546}, "total_wall_ms": 26749.359791981988, "ttft_ms": 11.96850009728223, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6d9f808101708f68c960c3aa", "attempt_id": "447a22f1d5ab", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:11.904778Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.30774998106062, "ttft_ms": 12.088541989214718, "decode_ms": 106.47579201031476}, "total_wall_ms": 26771.668457891792, "ttft_ms": 12.088541989214718, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7fbef4fe984176467b6c5f17", "attempt_id": "738c12f40b4c", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:12.266795Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.79329197853804, "ttft_ms": 12.054541031830013, "decode_ms": 12.051792000420392}, "total_wall_ms": 26677.702624816447, "ttft_ms": 12.054541031830013, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7814552da275c5d5d653991", "attempt_id": "a2a35a8c7a74", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:12.534918Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.98087489698082, "ttft_ms": 12.00774998869747, "decode_ms": 11.901167104952037}, "total_wall_ms": 26677.675499930046, "ttft_ms": 12.00774998869747, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c2cb6639cb073103e140adc2", "attempt_id": "e8fa8930ff14", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:12.803172Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.3444580603391, "ttft_ms": 12.020500027574599, "decode_ms": 12.003917014226317}, "total_wall_ms": 26677.15237592347, "ttft_ms": 12.020500027574599, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a9e5768ece59f38e62e92ef4", "attempt_id": "7e8dd2c472ce", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:13.071146Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.0023329872638, "ttft_ms": 12.39254092797637, "decode_ms": 12.073875055648386}, "total_wall_ms": 26677.256583818235, "ttft_ms": 12.39254092797637, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "16081d619c57b203592d22f9", "attempt_id": "63674f47490a", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:13.338648Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 228.54979196563363, "ttft_ms": 12.095917016267776, "decode_ms": 83.30291707534343}, "total_wall_ms": 26750.76162489131, "ttft_ms": 12.095917016267776, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 3400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2547156712741e8aac6a6cdf", "attempt_id": "60a208b3fe78", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:13.680175Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.7534170532599, "ttft_ms": 12.13912502862513, "decode_ms": 83.0200829077512}, "total_wall_ms": 26748.7223749049, "ttft_ms": 12.13912502862513, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 3401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cba452fd0ef4d0ad5eee6d55", "attempt_id": "f113f24d7ee1", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.019455Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 228.5613330313936, "ttft_ms": 12.18979200348258, "decode_ms": 83.81041698157787}, "total_wall_ms": 26751.38504197821, "ttft_ms": 12.18979200348258, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 3402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "77c228a0255d05bd3e716f7a", "attempt_id": "8dca5e3ee55f", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.361333Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 227.13570797350258, "ttft_ms": 12.029916979372501, "decode_ms": 106.78820800967515}, "total_wall_ms": 26772.779416874982, "ttft_ms": 12.029916979372501, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450165", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "a929e5c5097069e202c39470de0d2861ac8d456564e72788db30daadb9f19129"} | ||||
| 3403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "90f071cd7a7512b245abfaf4", "attempt_id": "7fc026131e9f", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.725338Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.80549998767674, "ttft_ms": 11.990292114205658, "decode_ms": 11.960500036366284}, "total_wall_ms": 26677.562749944627, "ttft_ms": 11.990292114205658, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be95d7f7e3a3c4a6c32f37c2", "attempt_id": "a19119267cf5", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.993732Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 227.09733399096876, "ttft_ms": 12.04025000333786, "decode_ms": 12.06674997229129}, "total_wall_ms": 26678.004707908258, "ttft_ms": 12.04025000333786, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8c86339a3eb4ef398fe6e60", "attempt_id": "ed9390d91aec", "run_group_id": "E4_core:A4|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:15.262618Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 2562, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26426.132791908458, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466}, "receiver_prefill_ms": 226.85412492137402, "ttft_ms": 12.025041971355677, "decode_ms": 11.947166989557445}, "total_wall_ms": 26677.633916959167, "ttft_ms": 12.025041971355677, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1aeb5f54937e2da6c8994065", "attempt_id": "84421481d492", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:41.492059Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.67104098945856, "ttft_ms": 12.146624969318509, "decode_ms": 11.900875018909574}, "total_wall_ms": 52633.19920876529, "ttft_ms": 12.146624969318509, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7f9bf270ea8291e919e4a1a5", "attempt_id": "ad561d8fbe8c", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:41.760404Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.53450001962483, "ttft_ms": 12.05608295276761, "decode_ms": 142.4653750145808}, "total_wall_ms": 52763.53699970059, "ttft_ms": 12.05608295276761, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "02f5591b35570cef9a088d74", "attempt_id": "515f7bc01037", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:42.158505Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.54391604010016, "ttft_ms": 12.045416980981827, "decode_ms": 83.09945906512439}, "total_wall_ms": 52704.16529173963, "ttft_ms": 12.045416980981827, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e6868a843a0607f2e10955b", "attempt_id": "4feec602560f", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:42.497689Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.34745901450515, "ttft_ms": 12.016375083476305, "decode_ms": 106.95979208685458}, "total_wall_ms": 52727.82749973703, "ttft_ms": 12.016375083476305, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c690b3481e12ef11a37e8bd8", "attempt_id": "2b32d4dc5ecb", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:42.860218Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.99391597416252, "ttft_ms": 12.069249991327524, "decode_ms": 11.948042083531618}, "total_wall_ms": 52633.48758383654, "ttft_ms": 12.069249991327524, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d10c2a97d11f73b5ef257795", "attempt_id": "382b8e78bdc2", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.128682Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.90041607711464, "ttft_ms": 12.111415970139205, "decode_ms": 11.93616702221334}, "total_wall_ms": 52633.430541842245, "ttft_ms": 12.111415970139205, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e404a7952c0b16c741688be7", "attempt_id": "c8df5a819e29", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.397029Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.5007080277428, "ttft_ms": 12.092125019989908, "decode_ms": 11.913749971427023}, "total_wall_ms": 52632.952208747156, "ttft_ms": 12.092125019989908, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9472f66c3be2613e05c931a8", "attempt_id": "020415f015e0", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.664623Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.55254194978625, "ttft_ms": 12.070374912582338, "decode_ms": 11.949707986786962}, "total_wall_ms": 52633.06937471498, "ttft_ms": 12.070374912582338, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bbabcc96cd5a72fe8435034a", "attempt_id": "4c3758da9756", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.932245Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 228.38616697117686, "ttft_ms": 12.151625007390976, "decode_ms": 83.05100002326071}, "total_wall_ms": 52706.074374727905, "ttft_ms": 12.151625007390976, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 3415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "034ef50cc7813b185f117602", "attempt_id": "90e5c712bda0", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:44.273141Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.02399997413158, "ttft_ms": 12.103083077818155, "decode_ms": 83.07608298491687}, "total_wall_ms": 52703.70483270381, "ttft_ms": 12.103083077818155, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6056150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "f016f8b5fc26708e6c1ff75ff8e98659082c41a168f273819ac48b88feea8d3f"} | ||||
| 3416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0b31d55d64cec5592c667b90", "attempt_id": "92a51ed65cb9", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:44.612304Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 228.62429195083678, "ttft_ms": 12.161041027866304, "decode_ms": 83.1940839998424}, "total_wall_ms": 52706.45424979739, "ttft_ms": 12.161041027866304, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 3417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ad6f532b3b569a830dcf7911", "attempt_id": "22e400367940", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:44.953782Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.94208403117955, "ttft_ms": 12.143999920226634, "decode_ms": 119.12737495731562}, "total_wall_ms": 52740.74666574597, "ttft_ms": 12.143999920226634, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,777", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "3894c3c39e5c76c297dfb1859a5e1724e2454039e072357510c841bc907d01a5"} | ||||
| 3418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b84b69525c6fcba469e0f1b8", "attempt_id": "6a67ca0887d2", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:45.330111Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.91083303652704, "ttft_ms": 12.10962503682822, "decode_ms": 12.047167052514851}, "total_wall_ms": 52633.554916712455, "ttft_ms": 12.10962503682822, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3a6ef133feda9ecc7a8e4e63", "attempt_id": "3e87f416fec5", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:45.599182Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.62904195021838, "ttft_ms": 12.135457945987582, "decode_ms": 11.944000027142465}, "total_wall_ms": 52633.18341667764, "ttft_ms": 12.135457945987582, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4a334d56e7944cbea659c31e", "attempt_id": "d308556439b7", "run_group_id": "E4_core:A4|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:45.867476Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 5978, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 52381.81649975013, "hops": {"1": 6913.723333040252, "2": 6537.521208985709, "3": 6488.541791914031, "4": 6486.346457968466, "5": 6492.82487493474, "6": 6482.172666001134, "7": 6484.1609169961885, "8": 6496.52524990961}, "receiver_prefill_ms": 226.80845798458904, "ttft_ms": 12.105750036425889, "decode_ms": 11.993582942523062}, "total_wall_ms": 52633.39083374012, "ttft_ms": 12.105750036425889, "input_usage": {"lookups": 28}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "3": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "4": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "5": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "6": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "7": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "8": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dab64d0a547352a5de2a9544", "attempt_id": "13793f9a59d3", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.041817Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 411, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 161.35308309458196, "ttft_ms": 11.968999984674156, "decode_ms": 11.747209005989134}, "total_wall_ms": 7090.143167064525, "ttft_ms": 11.968999984674156, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "98e33e69fcd96548462d24e8", "attempt_id": "1f644926e934", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.244476Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 418, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.33229194767773, "ttft_ms": 12.009500060230494, "decode_ms": 11.792459059506655}, "total_wall_ms": 7091.230208054185, "ttft_ms": 12.009500060230494, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5fc6b89d06b24bae9d1c3f3a", "attempt_id": "af09ad849a74", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.448073Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 417, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.48287493363023, "ttft_ms": 11.940457974560559, "decode_ms": 11.760167079046369}, "total_wall_ms": 7091.2466669688, "ttft_ms": 11.940457974560559, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aa2a802f302d6af100ca2314", "attempt_id": "949a3ae10a75", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.651464Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 161.80162504315376, "ttft_ms": 12.081459048204124, "decode_ms": 106.64941591676325}, "total_wall_ms": 7185.678042005748, "ttft_ms": 12.081459048204124, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83714a2aa1eb09dc4279d2d0", "attempt_id": "bc10c9c8df81", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.949155Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.68145805224776, "ttft_ms": 11.984875076450408, "decode_ms": 11.788874980993569}, "total_wall_ms": 7091.526416945271, "ttft_ms": 11.984875076450408, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6bd30c8f10b52862d5810f45", "attempt_id": "7d2fe4959243", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.152836Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.5219580018893, "ttft_ms": 12.112334021367133, "decode_ms": 118.49020794034004}, "total_wall_ms": 7198.215292068198, "ttft_ms": 12.112334021367133, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 3427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b7896adeafc7d849a4c3a0af", "attempt_id": "11e6a2cd6e04", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.463119Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.01400000136346, "ttft_ms": 11.932500055991113, "decode_ms": 11.78358297329396}, "total_wall_ms": 7090.810250956565, "ttft_ms": 11.932500055991113, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "62d9ca57dfb4018dc86169d0", "attempt_id": "72f06d99d7df", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.665921Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 413, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 161.93608404137194, "ttft_ms": 11.971125029958785, "decode_ms": 11.868417030200362}, "total_wall_ms": 7090.858459006995, "ttft_ms": 11.971125029958785, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "bc3895362ef22e676128c686", "attempt_id": "60e76ad9438f", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:54.868576Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.84087498206645, "ttft_ms": 11.946416925638914, "decode_ms": 105.67383305169642}, "total_wall_ms": 7185.53083401639, "ttft_ms": 11.946416925638914, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9e7f5534461c015a02fa459f", "attempt_id": "dfdd77e8b190", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.165960Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.5372909475118, "ttft_ms": 11.957375099882483, "decode_ms": 93.99795904755592}, "total_wall_ms": 7173.577666981146, "ttft_ms": 11.957375099882483, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | ||||
| 3431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9bea21ab7d2e05318774b882", "attempt_id": "c24f4d354a96", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.451771Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 430, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.81020897440612, "ttft_ms": 11.880208039656281, "decode_ms": 11.8079170351848}, "total_wall_ms": 7091.553583042696, "ttft_ms": 11.880208039656281, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "805673cfffe8889e3fd2bff6", "attempt_id": "424674c91996", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.655480Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.78024995699525, "ttft_ms": 11.979625094681978, "decode_ms": 82.71695801522583}, "total_wall_ms": 7162.57908300031, "ttft_ms": 11.979625094681978, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "69eab1984a9641b97adf6fc1", "attempt_id": "0ef1215be621", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.930212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.80720895156264, "ttft_ms": 11.959749972447753, "decode_ms": 11.858667014166713}, "total_wall_ms": 7091.693707974628, "ttft_ms": 11.959749972447753, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b11dc7bbca785c64eba7d265", "attempt_id": "6d626ab87bb7", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:56.133825Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 163.12254196964204, "ttft_ms": 12.071083998307586, "decode_ms": 11.853625066578388}, "total_wall_ms": 7092.146209091879, "ttft_ms": 12.071083998307586, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "03714abd5e5ec0e00f0eb703", "attempt_id": "6f4a2578c06b", "run_group_id": "E4_core:A5|repairable|qwen3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:56.337725Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 425, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6904.5422920025885, "hops": {"1": 6904.5422920025885}, "receiver_prefill_ms": 162.3170409584418, "ttft_ms": 11.97616697754711, "decode_ms": 11.79329096339643}, "total_wall_ms": 7091.1500009242445, "ttft_ms": 11.97616697754711, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e775fc3bab68ed83ead8cea7", "attempt_id": "0ae83bca10c1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:00.922722Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.09245810750872, "ttft_ms": 11.985916993580759, "decode_ms": 12.057916959747672}, "total_wall_ms": 11471.509834052995, "ttft_ms": 11.985916993580759, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "1696aaf6c268c3e6658bf492", "attempt_id": "127a32e44648", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.126583Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.84387500490993, "ttft_ms": 11.996875051409006, "decode_ms": 11.861791950650513}, "total_wall_ms": 11472.064876114018, "ttft_ms": 11.996875051409006, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0d07e34dce806c0e6cb7bed6", "attempt_id": "832687ce30a6", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.330487Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 426, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.6890420448035, "ttft_ms": 12.013040948659182, "decode_ms": 11.781834065914154}, "total_wall_ms": 11471.826125052758, "ttft_ms": 12.013040948659182, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d8968a0a4346de1fecc8dcb5", "attempt_id": "fe0b5ef8e6a2", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.533918Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.48783294577152, "ttft_ms": 12.087165960110724, "decode_ms": 106.29158304072917}, "total_wall_ms": 11566.244917106815, "ttft_ms": 12.087165960110724, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d7c55ef06bfb85aedf69d997", "attempt_id": "e1929096b231", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:01.831743Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.69545897375792, "ttft_ms": 12.013084022328258, "decode_ms": 11.807791073806584}, "total_wall_ms": 11471.873625996523, "ttft_ms": 12.013084022328258, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "17e55ae417f32d2b1cfa701e", "attempt_id": "fca1fcbc54f1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.035823Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.11737499199808, "ttft_ms": 11.956166941672564, "decode_ms": 117.67824995331466}, "total_wall_ms": 11578.09308404103, "ttft_ms": 11.956166941672564, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 3442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ab5af495ee733eb9022b0f44", "attempt_id": "9889aead7b6e", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.345805Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.54537494387478, "ttft_ms": 11.936415918171406, "decode_ms": 11.806041933596134}, "total_wall_ms": 11471.638292074203, "ttft_ms": 11.936415918171406, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8dbd1b624ce6756619d5ba71", "attempt_id": "c01f4066c5d1", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.548884Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 422, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.00804202910513, "ttft_ms": 11.888957931660116, "decode_ms": 11.774999904446304}, "total_wall_ms": 11472.005667048506, "ttft_ms": 11.888957931660116, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3e771d59b7a17f49bb2df650", "attempt_id": "7f3d6a008293", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.752438Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 436, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.1523750256747, "ttft_ms": 12.022958020679653, "decode_ms": 106.00737505592406}, "total_wall_ms": 11566.529459087178, "ttft_ms": 12.022958020679653, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "cdd456e1214b18e16a30fac5", "attempt_id": "5e7a25bfad26", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.050493Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.13912498299032, "ttft_ms": 12.226958060637116, "decode_ms": 94.86566693522036}, "total_wall_ms": 11555.596334044822, "ttft_ms": 12.226958060637116, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | ||||
| 3446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d5fa1ff6cab1fe04d163a98f", "attempt_id": "e3add4802be9", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.338111Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 439, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.31266600172967, "ttft_ms": 11.974875000305474, "decode_ms": 11.80491701234132}, "total_wall_ms": 11472.441207966767, "ttft_ms": 11.974875000305474, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4886b86ef15b303367702cf0", "attempt_id": "ad0f77ee89ed", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.542500Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.80037490651011, "ttft_ms": 12.014084029942751, "decode_ms": 82.52329204697162}, "total_wall_ms": 11542.69691708032, "ttft_ms": 12.014084029942751, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8e825058dd772199c9e5477d", "attempt_id": "1bfcc1f9fe83", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:03.816780Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.76987502351403, "ttft_ms": 11.977499932982028, "decode_ms": 11.774958111345768}, "total_wall_ms": 11471.862250007689, "ttft_ms": 11.977499932982028, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "de6ad348ea47793b0c2e5cbc", "attempt_id": "7cdfd5890c82", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:04.020291Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 162.82299999147654, "ttft_ms": 11.96270901709795, "decode_ms": 11.970332940109074}, "total_wall_ms": 11472.077584010549, "ttft_ms": 11.96270901709795, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4908d3841e4aa6f2b500f61c", "attempt_id": "8d77966a0093", "run_group_id": "E4_core:A5|repairable|qwen3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:04.223968Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 434, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 602, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11284.805292030796, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208}, "receiver_prefill_ms": 163.1097919307649, "ttft_ms": 11.991541017778218, "decode_ms": 11.808917042799294}, "total_wall_ms": 11472.263500094414, "ttft_ms": 11.991541017778218, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9c21f8bb1ddde17384c00141", "attempt_id": "fc6bc5a2e662", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.176836Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.25183405913413, "ttft_ms": 11.997958994470537, "decode_ms": 11.784625006839633}, "total_wall_ms": 20218.177042203024, "ttft_ms": 11.997958994470537, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751f48bf49f0ad6f27c2923c", "attempt_id": "0d3c69cf0d1a", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.380555Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.82395797315985, "ttft_ms": 11.958041926845908, "decode_ms": 11.7972920415923}, "total_wall_ms": 20218.719209195115, "ttft_ms": 11.958041926845908, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "17756b5049a9ffcad090e3dc", "attempt_id": "2b4b553f47d8", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.584240Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 426, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.5250829383731, "ttft_ms": 11.995665961876512, "decode_ms": 11.941708973608911}, "total_wall_ms": 20218.64683413878, "ttft_ms": 11.995665961876512, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4fb0caa5a627939e76f5829e", "attempt_id": "c3f6dce83c68", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:13.787718Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.5159999821335, "ttft_ms": 11.918375035747886, "decode_ms": 105.98783404566348}, "total_wall_ms": 20312.572292168625, "ttft_ms": 11.918375035747886, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5d8d5b194d65cc28b41287ea", "attempt_id": "49fb1f6cdb05", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.084874Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.71654202137142, "ttft_ms": 11.935874936170876, "decode_ms": 11.876665987074375}, "total_wall_ms": 20218.70729222428, "ttft_ms": 11.935874936170876, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e9b2d46179221737e4c2d757", "attempt_id": "143eb2af9a23", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.288549Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.1305000046268, "ttft_ms": 12.034083949401975, "decode_ms": 117.69745801575482}, "total_wall_ms": 20325.0216251472, "ttft_ms": 12.034083949401975, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 3457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f5048c85a91773bb28f02db4", "attempt_id": "c73e1c7bda90", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.599141Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.68974996637553, "ttft_ms": 11.981167015619576, "decode_ms": 11.93391706328839}, "total_wall_ms": 20218.790667131543, "ttft_ms": 11.981167015619576, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f8a1cf03bd27bfbb71932f5e", "attempt_id": "019f9ca3f15b", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:14.802881Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 422, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.5451250001788, "ttft_ms": 11.957417009398341, "decode_ms": 11.788124917075038}, "total_wall_ms": 20218.4524590848, "ttft_ms": 11.957417009398341, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c000a339087b6ea282931afe", "attempt_id": "27a4a925085e", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.006497Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 436, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.19950006436557, "ttft_ms": 12.186832958832383, "decode_ms": 105.9744170634076}, "total_wall_ms": 20313.508458202705, "ttft_ms": 12.186832958832383, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2d448014a3e584e8cfd601c7", "attempt_id": "af2cbca5a0f9", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.304998Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.2902089729905, "ttft_ms": 11.997041990980506, "decode_ms": 94.16520793456584}, "total_wall_ms": 20300.61170924455, "ttft_ms": 11.997041990980506, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828865", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b38715dfc60d964ebea3bdcc90d47ca28d803114815818233d093f08214df6ae"} | ||||
| 3461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7746e3e1fe1d98dd566c83cc", "attempt_id": "d7eb50fd6d38", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.591636Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 439, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.38491695933044, "ttft_ms": 11.889249901287258, "decode_ms": 11.825541034340858}, "total_wall_ms": 20219.235292170197, "ttft_ms": 11.889249901287258, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d34ecd59b92be4ad062bcd17", "attempt_id": "ad42a4f2d6bf", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:15.795807Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.17116608843207, "ttft_ms": 12.047125026583672, "decode_ms": 82.41575001738966}, "total_wall_ms": 20289.788750116713, "ttft_ms": 12.047125026583672, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0d09153a036bf6cc557aec7b", "attempt_id": "55c108237e98", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.071138Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.26541600190103, "ttft_ms": 11.967791011556983, "decode_ms": 11.867208988405764}, "total_wall_ms": 20218.269708100706, "ttft_ms": 11.967791011556983, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e7df7cfd0881c4bd8729c5fa", "attempt_id": "f89a2eb1f0b5", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.274252Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 162.85170800983906, "ttft_ms": 11.99487503618002, "decode_ms": 11.803624918684363}, "total_wall_ms": 20218.79883413203, "ttft_ms": 11.99487503618002, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "71464fbbcc1692cd9e7f4cce", "attempt_id": "6cbe67c15efd", "run_group_id": "E4_core:A5|repairable|qwen3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.478275Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 434, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 1806, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 20031.605917145498, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101}, "receiver_prefill_ms": 163.19333296269178, "ttft_ms": 11.967458995059133, "decode_ms": 11.754250037483871}, "total_wall_ms": 20219.068792182952, "ttft_ms": 11.967458995059133, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b4afafb68040b44b9c1fc82c", "attempt_id": "5d6eb1e3f4eb", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.206915Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.8488750429824, "ttft_ms": 11.996084009297192, "decode_ms": 11.838959064334631}, "total_wall_ms": 37738.89483406674, "ttft_ms": 11.996084009297192, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d6f948964e92b522b70f6569", "attempt_id": "23ad64ba0e56", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.411332Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.86229202523828, "ttft_ms": 11.990666971541941, "decode_ms": 11.968291946686804}, "total_wall_ms": 37738.99479303509, "ttft_ms": 11.990666971541941, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c00aac3fe9fd50be18cae024", "attempt_id": "8a4b5312840e", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.615554Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 426, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.7461250172928, "ttft_ms": 12.085292022675276, "decode_ms": 11.794500052928925}, "total_wall_ms": 37738.796918070875, "ttft_ms": 12.085292022675276, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ac28b052817fd71b7c34046d", "attempt_id": "6853feec4d2e", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:34.819212Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.26975002791733, "ttft_ms": 11.933750007301569, "decode_ms": 105.8265829924494}, "total_wall_ms": 37832.18812500127, "ttft_ms": 11.933750007301569, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9cdbccae53bba2d9a4d44a84", "attempt_id": "f203b1c63fa8", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.116097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.9758341005072, "ttft_ms": 12.005583965219557, "decode_ms": 11.819457984529436}, "total_wall_ms": 37738.981500966474, "ttft_ms": 12.005583965219557, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "acad1d07d8826bbc007c28f0", "attempt_id": "d5cd60bdd5c8", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.320506Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.78112505096942, "ttft_ms": 11.994667001999915, "decode_ms": 117.7488750545308}, "total_wall_ms": 37844.68225098681, "ttft_ms": 11.994667001999915, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 3472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7a240f56fa53b0d50b39a871", "attempt_id": "52484533d07c", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.630298Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 421, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.44033304974437, "ttft_ms": 11.959042050875723, "decode_ms": 11.80325006134808}, "total_wall_ms": 37738.37541707326, "ttft_ms": 11.959042050875723, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "74c23190343c10ac03dbf635", "attempt_id": "df1d707151eb", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:35.833524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 422, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.72825002670288, "ttft_ms": 12.043875060044229, "decode_ms": 11.784875066950917}, "total_wall_ms": 37738.72566805221, "ttft_ms": 12.043875060044229, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6ee2d494446dd486ca015d17", "attempt_id": "856c43d4ce76", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.036757Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 436, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.82924998085946, "ttft_ms": 12.080707936547697, "decode_ms": 106.78008291870356}, "total_wall_ms": 37833.86616699863, "ttft_ms": 12.080707936547697, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fb8baac8f08eb7f253855b90", "attempt_id": "7e86b02eb9a8", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.335315Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.19829202257097, "ttft_ms": 12.103290995582938, "decode_ms": 94.25379196181893}, "total_wall_ms": 37821.74595899414, "ttft_ms": 12.103290995582938, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828869", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "c37a6a24f6b43a5a4c626354b69a44fd62c2a91de72daee7f63e18e6519e339c"} | ||||
| 3476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f983dd5cc660adb3a0944dc3", "attempt_id": "3428f9ab3c0d", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.621764Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 439, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.37683296296746, "ttft_ms": 12.100375024601817, "decode_ms": 11.785792070440948}, "total_wall_ms": 37739.43362594582, "ttft_ms": 12.100375024601817, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5a3b938433b7325380210ba5", "attempt_id": "d16eade7a533", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.826294Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.18254102952778, "ttft_ms": 11.924582999199629, "decode_ms": 82.65087497420609}, "total_wall_ms": 37809.9230841035, "ttft_ms": 11.924582999199629, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ae97db2ca3bf2b857c0c4853", "attempt_id": "855320fc4edc", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:37.100907Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.13762497156858, "ttft_ms": 12.296458939090371, "decode_ms": 12.01220799703151}, "total_wall_ms": 37739.60337601602, "ttft_ms": 12.296458939090371, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e5f61921fb6e86702125797a", "attempt_id": "7806cd14f4fb", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:37.305026Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 432, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 162.32495789881796, "ttft_ms": 11.958708055317402, "decode_ms": 11.77216600626707}, "total_wall_ms": 37738.21370897349, "ttft_ms": 11.958708055317402, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2164eaf55adec160350afcea", "attempt_id": "4028e3ae5bf4", "run_group_id": "E4_core:A5|repairable|qwen3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:37.508467Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 434, "message_tokens": 339, "message_utf8_bytes": 858, "cache_tensor_bytes": null, "serialized_payload_bytes": 858, "side_information_bytes": 0, "fetched_bytes": 4214, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 37551.62508401554, "hops": {"1": 6904.5422920025885, "2": 4380.263000028208, "3": 4375.677625066601, "4": 4371.123000048101, "5": 4391.168999951333, "6": 4377.536708954722, "7": 4374.012624961324, "8": 4377.300833002664}, "receiver_prefill_ms": 163.11120800673962, "ttft_ms": 12.010792037472129, "decode_ms": 11.776332976296544}, "total_wall_ms": 37739.052542019635, "ttft_ms": 12.010792037472129, "input_usage": {"lookups": 7}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 818}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "7ab33a7e50920be6dd2887eea3e354ca9b7ea53ad5cd929f38c58204c3e3af7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ecf378f18f83e91a4a2bb009", "attempt_id": "a840f58ffae3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:44.586850Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.39816696755588, "ttft_ms": 12.008749996311963, "decode_ms": 11.808292008936405}, "total_wall_ms": 7123.195458087139, "ttft_ms": 12.008749996311963, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3717a5487ca301c1b90e712a", "attempt_id": "18e238d8b598", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:44.854300Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.32675000932068, "ttft_ms": 12.204624945297837, "decode_ms": 141.75216702278703}, "total_wall_ms": 7253.243750077672, "ttft_ms": 12.204624945297837, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f39015b7f4b92e8aadb79155", "attempt_id": "5821318a51f3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:45.251472Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.2632919009775, "ttft_ms": 12.079749954864383, "decode_ms": 82.49475003685802}, "total_wall_ms": 7193.786250078119, "ttft_ms": 12.079749954864383, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "89afbd65374758573e3bf235", "attempt_id": "993379ddccbd", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:45.589886Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.6386670526117, "ttft_ms": 12.205207953229547, "decode_ms": 107.5730420416221}, "total_wall_ms": 7219.407292082906, "ttft_ms": 12.205207953229547, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a6ceb38c7a36d3b76b121ce6", "attempt_id": "558191f219e4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:45.953968Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.708208094351, "ttft_ms": 12.044125003740191, "decode_ms": 11.885791085660458}, "total_wall_ms": 7123.605582979508, "ttft_ms": 12.044125003740191, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d55940ad814ea51f66aa670d", "attempt_id": "a0400bdb8e95", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:46.222757Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 227.11304191034287, "ttft_ms": 12.050083023495972, "decode_ms": 11.975583038292825}, "total_wall_ms": 7124.084834009409, "ttft_ms": 12.050083023495972, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3487 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5f64637debfcb3abed126c29", "attempt_id": "9d1ee3a7170e", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:46.490727Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.7370419576764, "ttft_ms": 12.006000033579767, "decode_ms": 11.910791974514723}, "total_wall_ms": 7123.604124994017, "ttft_ms": 12.006000033579767, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3488 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "00dcee01a631ac4074851cfd", "attempt_id": "ed9d5d16718b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:46.758253Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.4244999969378, "ttft_ms": 12.102290987968445, "decode_ms": 11.87124999705702}, "total_wall_ms": 7123.323500039987, "ttft_ms": 12.102290987968445, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 3489 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dff5d1c7f0b819f9c7b485ba", "attempt_id": "d5715475cd55", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:47.025362Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 228.43862499576062, "ttft_ms": 11.999665992334485, "decode_ms": 82.97087496612221}, "total_wall_ms": 7196.34866702836, "ttft_ms": 11.999665992334485, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8010205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "6d1ceb36132f38bd77e8f46c23ea21dd9bcff78bc80bd8a9eaf2d7f2f3bacf46"} | ||||
| 3490 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4d5374393eb6553718c49068", "attempt_id": "b5aa76e038db", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:47.366144Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 227.09895798470825, "ttft_ms": 12.103792047128081, "decode_ms": 106.72749998047948}, "total_wall_ms": 7218.880292028189, "ttft_ms": 12.103792047128081, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 3491 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dda8b0ccc53ee42e5fc7832f", "attempt_id": "891dc21a2a8e", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:47.729631Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 228.44483295921236, "ttft_ms": 12.022083974443376, "decode_ms": 82.89099996909499}, "total_wall_ms": 7196.3205829961225, "ttft_ms": 12.022083974443376, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunlith-13", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "c45f000afe6d865c8167954eebdff761141225817d4f5b26c962cd50cd75d391"} | ||||
| 3492 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "59f470b9d69dff39cae28df5", "attempt_id": "d64745a6af00", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.070402Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.62149998359382, "ttft_ms": 12.313459068536758, "decode_ms": 118.08500008191913}, "total_wall_ms": 7229.986250051297, "ttft_ms": 12.313459068536758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,450,077", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "2044d7c4afd32892ac22705680e35174db83308c139b02a1494275cc5e24aff3"} | ||||
| 3493 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c7c9cca67d997a388d204358", "attempt_id": "d513539d765d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.444654Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.81825002655387, "ttft_ms": 11.991707957349718, "decode_ms": 11.848459020256996}, "total_wall_ms": 7123.618375044316, "ttft_ms": 11.991707957349718, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3494 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "55e681c17db92b0fcb649758", "attempt_id": "93a9f185f633", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.712735Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 226.541250012815, "ttft_ms": 12.040166067890823, "decode_ms": 11.896249954588711}, "total_wall_ms": 7123.438459006138, "ttft_ms": 12.040166067890823, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3495 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3a2c56a8ebbc43adf3d95555", "attempt_id": "3e06879f4692", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:48.980309Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6872.302875039168, "hops": {"1": 6872.302875039168}, "receiver_prefill_ms": 227.02700004447252, "ttft_ms": 11.992000043392181, "decode_ms": 11.835499899461865}, "total_wall_ms": 7123.790000099689, "ttft_ms": 11.992000043392181, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "1f88f0e78c63504e418dea843641b99a98555e15d47b02cd5cb2f57da3003dea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3496 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "292f2d35ea7fc966ba58c3f3", "attempt_id": "5b0fd0a05039", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:54.292130Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 519, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.1570000629872, "ttft_ms": 11.686292011290789, "decode_ms": 11.701290961354971}, "total_wall_ms": 12148.171665961854, "ttft_ms": 11.686292011290789, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3497 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "429d9dd81e60b3d3340970fe", "attempt_id": "c3fe10eaf7c7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:54.542884Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 526, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.60116700734943, "ttft_ms": 11.759374989196658, "decode_ms": 114.80199999641627}, "total_wall_ms": 12251.792415976524, "ttft_ms": 11.759374989196658, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3498 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3afedd96345ac9c9ea4879fa", "attempt_id": "e8c232196903", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:54.896436Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 525, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.69383302144706, "ttft_ms": 11.725250049494207, "decode_ms": 45.76870799064636}, "total_wall_ms": 12182.807583012618, "ttft_ms": 11.725250049494207, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3499 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ec7e80efbd61a7c2cc8f41a2", "attempt_id": "5ae3f837d63c", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:55.180655Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 521, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.19991703704, "ttft_ms": 11.640792014077306, "decode_ms": 103.30366692505777}, "total_wall_ms": 12239.772083004937, "ttft_ms": 11.640792014077306, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3500 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4bbc2899b863a572a5b9185e", "attempt_id": "02c13bf379fd", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:55.521554Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 532, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 210.0380000192672, "ttft_ms": 11.629624990746379, "decode_ms": 11.488749994896352}, "total_wall_ms": 12148.786542005837, "ttft_ms": 11.629624990746379, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3501 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ca5a2d032fdbe4fb5cd4d564", "attempt_id": "c422f312da6d", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:55.771576Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 527, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.37150006648153, "ttft_ms": 11.71729201450944, "decode_ms": 11.523833964020014}, "total_wall_ms": 12148.233084008098, "ttft_ms": 11.71729201450944, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3502 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "751968142b8b3167a2b7f5d4", "attempt_id": "bb63684a4bb5", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.021535Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 521, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.30079196114093, "ttft_ms": 11.983166914433241, "decode_ms": 22.998959058895707}, "total_wall_ms": 12159.89487490151, "ttft_ms": 11.983166914433241, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3503 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d3935d5524047cfa8f9b2bf0", "attempt_id": "f11c6fb95282", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.282596Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 521, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.30437499191612, "ttft_ms": 11.904875049367547, "decode_ms": 22.978166001848876}, "total_wall_ms": 12159.794874954969, "ttft_ms": 11.904875049367547, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3504 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "72e3acf0e01234d3aeab6cee", "attempt_id": "99801e1fe749", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.544602Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 536, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.90879100281745, "ttft_ms": 11.64100004825741, "decode_ms": 57.76754196267575}, "total_wall_ms": 12194.930416997522, "ttft_ms": 11.64100004825741, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,010,205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "12facbb746e46f5872a48eea64f64dc2cbd9610b1548522078108253d03a7904"} | ||||
| 3505 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "780c38ae1e7a859fb34e6815", "attempt_id": "1280f2628e32", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:56.840885Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 529, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.10687500145286, "ttft_ms": 11.756792082451284, "decode_ms": 57.42233304772526}, "total_wall_ms": 12193.888499983586, "ttft_ms": 11.756792082451284, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 3506 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "be639b2a148fb27410da43bb", "attempt_id": "5f0e4c640208", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:57.136256Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 537, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 210.32570803072304, "ttft_ms": 11.808958020992577, "decode_ms": 11.568875052034855}, "total_wall_ms": 12149.332833010703, "ttft_ms": 11.808958020992577, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3507 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ee4d154591dcac9396307c9e", "attempt_id": "2c4ed2618709", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:57.386562Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 532, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 210.01262497156858, "ttft_ms": 11.720290989615023, "decode_ms": 298.07845898903906}, "total_wall_ms": 12435.455665923655, "ttft_ms": 11.720290989615023, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937 + 1,787,610 + 8,278,225 = 16,980,772", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.4}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "c5fb5d9b76b7a02439f0acb83233430b95eef4aa96f8df88b9152c3b3e51343c"} | ||||
| 3508 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8e0eb7bbee465867fbabf295", "attempt_id": "524a6272f179", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:57.924621Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 528, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.4906660495326, "ttft_ms": 11.656083050183952, "decode_ms": 11.460999958217144}, "total_wall_ms": 12148.191374959424, "ttft_ms": 11.656083050183952, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3509 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "83b00003e3fa4b248f69e837", "attempt_id": "d716a71b2147", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:58.174663Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 532, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.80624994263053, "ttft_ms": 11.868958012200892, "decode_ms": 23.161166929639876}, "total_wall_ms": 12160.468666930683, "ttft_ms": 11.868958012200892, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 3510 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "db09be4d7a69be2eb46431c3", "attempt_id": "f2e89c99e080", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:58.436190Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 534, "message_tokens": 416, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 11915.002124966122, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545}, "receiver_prefill_ms": 209.62866698391736, "ttft_ms": 11.73908298369497, "decode_ms": 11.487790965475142}, "total_wall_ms": 12148.470208980143, "ttft_ms": 11.73908298369497, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a84a1aff1e9050ab45ed7ed2bd9f5306446a866f8b9ff0cedf4ce4f983883642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3511 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "dfabe703c66f3f8e1bd3d719", "attempt_id": "4861d6afec1b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:09.758074Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 490, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 206.24066703021526, "ttft_ms": 11.743957991711795, "decode_ms": 11.539915925823152}, "total_wall_ms": 23213.434666977264, "ttft_ms": 11.743957991711795, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3512 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e4e2f414adcf3890df45d844", "attempt_id": "79f5b35dc816", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.004910Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 497, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.9006660496816, "ttft_ms": 11.733249993994832, "decode_ms": 115.8215410541743}, "total_wall_ms": 23319.396708044223, "ttft_ms": 11.733249993994832, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3513 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a13b47f56009315605b80552", "attempt_id": "f8ddb8dd3241", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.357057Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 496, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 205.87050006724894, "ttft_ms": 11.806832975707948, "decode_ms": 46.47175001446158}, "total_wall_ms": 23248.114499961957, "ttft_ms": 11.806832975707948, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3514 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8626319698b2c2156c13f0a7", "attempt_id": "0baf19023d48", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.638756Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 206.41062501817942, "ttft_ms": 11.7896250449121, "decode_ms": 104.55258307047188}, "total_wall_ms": 23306.675791041926, "ttft_ms": 11.7896250449121, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3515 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a9c34da8bf935186ca88ad1b", "attempt_id": "14b5fe2801a6", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:10.978972Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 208.06566695682704, "ttft_ms": 11.687041958793998, "decode_ms": 11.644500074908137}, "total_wall_ms": 23215.29337496031, "ttft_ms": 11.687041958793998, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3516 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9dafde273e18c4ee3e7069eb", "attempt_id": "50f610781441", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.227879Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 498, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.67320797313005, "ttft_ms": 11.876165983267128, "decode_ms": 11.814334080554545}, "total_wall_ms": 23215.294416993856, "ttft_ms": 11.876165983267128, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3517 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "aaa7a7add60ce5e11a1441e7", "attempt_id": "bba9fd272f81", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.476430Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 205.95729094929993, "ttft_ms": 11.706916033290327, "decode_ms": 23.29354197718203}, "total_wall_ms": 23224.83874997124, "ttft_ms": 11.706916033290327, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3518 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a7eac567267d564d1e795b39", "attempt_id": "f698f696c65b", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.734874Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.91820797603577, "ttft_ms": 11.799959000200033, "decode_ms": 23.308750009164214}, "total_wall_ms": 23226.958292070776, "ttft_ms": 11.799959000200033, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3519 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8358207eadeb8126475457b5", "attempt_id": "74feeb97cfa4", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:11.995903Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 507, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.12370902765542, "ttft_ms": 11.836000019684434, "decode_ms": 58.3128749858588}, "total_wall_ms": 23261.240166961215, "ttft_ms": 11.836000019684434, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,010,205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "12facbb746e46f5872a48eea64f64dc2cbd9610b1548522078108253d03a7904"} | ||||
| 3520 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df29ce9d3ec2ca091c6a5f91", "attempt_id": "338bb16699d3", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:12.291250Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 500, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 206.97824994567782, "ttft_ms": 11.8665830232203, "decode_ms": 58.1426250282675}, "total_wall_ms": 23260.930624906905, "ttft_ms": 11.8665830232203, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 3521 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c5a9c203da8d3c85f53bee8c", "attempt_id": "ddeef272b1c2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:12.585910Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 508, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.73366698995233, "ttft_ms": 11.777165927924216, "decode_ms": 11.898291064426303}, "total_wall_ms": 23215.30525002163, "ttft_ms": 11.777165927924216, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3522 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "df206db021827fbaf90b5d73", "attempt_id": "12a67fd78404", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:12.834295Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.91666698642075, "ttft_ms": 11.728040990419686, "decode_ms": 301.89700005576015}, "total_wall_ms": 23505.46812498942, "ttft_ms": 11.728040990419686, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937 + 1,787,610 + 8,278,225 = 16,980,772", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.4}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "c5fb5d9b76b7a02439f0acb83233430b95eef4aa96f8df88b9152c3b3e51343c"} | ||||
| 3523 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a25e6f29980ac10c153c7c60", "attempt_id": "3441fa81c60f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:13.373097Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 499, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 207.03924994450063, "ttft_ms": 11.80079102050513, "decode_ms": 11.682207928970456}, "total_wall_ms": 23214.439749950543, "ttft_ms": 11.80079102050513, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3524 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4ab18cd59050673e42c6dbf5", "attempt_id": "c4501c8859f7", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:13.620762Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 209.02758301235735, "ttft_ms": 11.82587502989918, "decode_ms": 11.626291903667152}, "total_wall_ms": 23216.419583070092, "ttft_ms": 11.82587502989918, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3525 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f865d1300eef0a30fee6d154", "attempt_id": "cdc13db857d0", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:13.870869Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 505, "message_tokens": 387, "message_utf8_bytes": 1023, "cache_tensor_bytes": null, "serialized_payload_bytes": 1023, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 22983.29725000076, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409}, "receiver_prefill_ms": 208.67758302483708, "ttft_ms": 11.671332991681993, "decode_ms": 11.490499950014055}, "total_wall_ms": 23215.73445899412, "ttft_ms": 11.671332991681993, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "9597ef7dd5408dec598b05726488fa7f8924bdb0755c45a0837fd9d429f51e78", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3526 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5bea7e952ef3124857ebf1e5", "attempt_id": "2bab77b0c2af", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:35.766587Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 490, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.54070791695267, "ttft_ms": 11.606125044636428, "decode_ms": 11.500791064463556}, "total_wall_ms": 44853.72995806392, "ttft_ms": 11.606125044636428, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3527 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6d04997b4e7393c1c4d422f7", "attempt_id": "0ca8e559b3c2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.012329Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 497, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.6505000218749, "ttft_ms": 11.552124982699752, "decode_ms": 114.7153329802677}, "total_wall_ms": 44956.97683293838, "ttft_ms": 11.552124982699752, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 3528 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5513ed92fbb9a62ad2e3e670", "attempt_id": "0b1358da766f", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.360524Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 496, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.58270800393075, "ttft_ms": 11.726291966624558, "decode_ms": 46.06037505436689}, "total_wall_ms": 44888.58349993825, "ttft_ms": 11.726291966624558, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 3529 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "342492acda34dd62c8927c7a", "attempt_id": "82e71c2e27fb", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.640029Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.49395796842873, "ttft_ms": 11.706040939316154, "decode_ms": 103.56912505812943}, "total_wall_ms": 44945.98799897358, "ttft_ms": 11.706040939316154, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3530 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fb7b0cba5561957abf2f9e7d", "attempt_id": "ff7eb9ea83c8", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:36.977139Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.89683295879513, "ttft_ms": 11.536833946593106, "decode_ms": 11.517417035065591}, "total_wall_ms": 44856.00374999922, "ttft_ms": 11.536833946593106, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3531 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ddae4fd2ea0f6622042da8a1", "attempt_id": "923a18f829ab", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.225005Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 498, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 206.6919170320034, "ttft_ms": 11.615708004683256, "decode_ms": 11.492042103782296}, "total_wall_ms": 44854.840541025624, "ttft_ms": 11.615708004683256, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3532 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e99444682b2647a9d1f225ef", "attempt_id": "1dc4f37b0538", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.470529Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 206.48579101543874, "ttft_ms": 11.523665976710618, "decode_ms": 22.95541705098003}, "total_wall_ms": 44865.99916697014, "ttft_ms": 11.523665976710618, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3533 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c82159bb6d1b2693879010ce", "attempt_id": "9cfc68fe24a1", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.727520Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 492, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 205.37658303510398, "ttft_ms": 11.629833024926484, "decode_ms": 23.068250040523708}, "total_wall_ms": 44865.222748951055, "ttft_ms": 11.629833024926484, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 3534 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a2a8eaa3f395a27f4ab5cedd", "attempt_id": "75fe32a71ebd", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.983494Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 507, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.95070903841406, "ttft_ms": 11.485417024232447, "decode_ms": 57.63437494169921}, "total_wall_ms": 44902.11654105224, "ttft_ms": 11.485417024232447, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,010,205", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "12facbb746e46f5872a48eea64f64dc2cbd9610b1548522078108253d03a7904"} | ||||
| 3535 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6f5cf23ff573451d905002c2", "attempt_id": "a49aebdd83cb", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:38.276726Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 500, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 206.10175002366304, "ttft_ms": 11.502541950903833, "decode_ms": 57.40062496624887}, "total_wall_ms": 44900.05395794287, "ttft_ms": 11.502541950903833, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,056,150", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "8262889a8478c7e0ee965f159d9849a3849b412e276f5b979476e2da5b320249"} | ||||
| 3536 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0660a5cf6123369c78d0112f", "attempt_id": "b83f846951b2", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:38.567754Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 508, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 208.3208749536425, "ttft_ms": 11.555084027349949, "decode_ms": 11.706332908943295}, "total_wall_ms": 44856.603916035965, "ttft_ms": 11.555084027349949, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3537 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8ff8a9e150f4804461a35ecf", "attempt_id": "944d46eb4f12", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:38.815297Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 208.48258293699473, "ttft_ms": 11.795250000432134, "decode_ms": 298.95991703961045}, "total_wall_ms": 45144.31745803449, "ttft_ms": 11.795250000432134, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937 + 1,787,610 + 8,278,225 = 16,980,772", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.4}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "c5fb5d9b76b7a02439f0acb83233430b95eef4aa96f8df88b9152c3b3e51343c"} | ||||
| 3538 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "74e98c76a3302f7e1645398b", "attempt_id": "730775e135cc", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:39.350078Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 499, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.86812505684793, "ttft_ms": 11.652125045657158, "decode_ms": 11.538667022250593}, "total_wall_ms": 44856.26437398605, "ttft_ms": 11.652125045657158, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3539 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "30ef5b3e969734698441069d", "attempt_id": "d2f6f26e05e1", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:39.597157Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 503, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 208.42470810748637, "ttft_ms": 11.685249977745116, "decode_ms": 11.51199999731034}, "total_wall_ms": 44856.84912500437, "ttft_ms": 11.685249977745116, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3540 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "25715c96bfa5e7120815644e", "attempt_id": "c8b533206d63", "run_group_id": "E4_core:A4|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:39.845092Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 505, "message_tokens": 387, "message_utf8_bytes": 1022, "cache_tensor_bytes": null, "serialized_payload_bytes": 1022, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 44624.60495799314, "hops": {"1": 6872.302875039168, "2": 5042.6992499269545, "3": 6354.470000020228, "4": 4713.825125014409, "5": 6335.791665944271, "6": 4672.110749990679, "7": 5924.405542085879, "8": 4708.999749971554}, "receiver_prefill_ms": 207.27558399084955, "ttft_ms": 11.788583011366427, "decode_ms": 11.573042022064328}, "total_wall_ms": 44855.82375002559, "ttft_ms": 11.788583011366427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 27, "retention_rate": 0.42857142857142855, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1087}, "2": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1063}, "3": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1062}, "4": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1023}, "5": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1050}, "6": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1010}, "7": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 992}, "8": {"facts_total": 63, "facts_retained": 24, "retention_rate": 0.38095238095238093, "retention_by_kind": {"person": 0.5, "date": 0.125, "amount": 0.6153846153846154, "status": 0.5, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1022}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "e5864c0b88a688a045e4eb1d1985303e81b16f7e80826e759450dac2bb9d2e48", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3541 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "5b8ad3e54d8c46a7a3708aaf", "attempt_id": "dfd63c4ee7a1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:46.997516Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 411, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.03166695777327, "ttft_ms": 11.918416945263743, "decode_ms": 11.814957950264215}, "total_wall_ms": 7088.69258291088, "ttft_ms": 11.918416945263743, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3542 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "25c983ff6d01a61fd9bc3a10", "attempt_id": "82a6c4a15660", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.200062Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 418, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.37533295154572, "ttft_ms": 11.79183297790587, "decode_ms": 11.748916003853083}, "total_wall_ms": 7089.861541986465, "ttft_ms": 11.79183297790587, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3543 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e666bc2522ce9a46111cef56", "attempt_id": "914b684296ff", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.403041Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 417, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.71820897236466, "ttft_ms": 11.816457961685956, "decode_ms": 11.783291003666818}, "total_wall_ms": 7089.226332958788, "ttft_ms": 11.816457961685956, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3544 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c99549ec9e7f764bfd39fcae", "attempt_id": "82c1267cbf76", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.605341Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.0434580836445, "ttft_ms": 11.916000046767294, "decode_ms": 106.1162919504568}, "total_wall_ms": 7183.022542041726, "ttft_ms": 11.916000046767294, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3545 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e30614e72986a0e897a531b7", "attempt_id": "c0ddc23ab826", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.901315Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.66183292120695, "ttft_ms": 11.917000054381788, "decode_ms": 11.772415949963033}, "total_wall_ms": 7090.299208997749, "ttft_ms": 11.917000054381788, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3546 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "809760b2e49d08da3c32504f", "attempt_id": "bc6711c52254", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.104427Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.67008304223418, "ttft_ms": 11.832458898425102, "decode_ms": 117.6555419806391}, "total_wall_ms": 7196.079499903135, "ttft_ms": 11.832458898425102, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WT-26M-9227", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "ef2302e0ab6f5a6951b11463fea177ba766b9d438afcaf6e6101ebfa3ba38aba"} | ||||
| 3547 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "91115ee512e65260a24be95a", "attempt_id": "11bcf2b8f656", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.413022Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 412, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.16120903845876, "ttft_ms": 11.766124982386827, "decode_ms": 11.783291003666818}, "total_wall_ms": 7088.605041964911, "ttft_ms": 11.766124982386827, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3548 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3f4d8191f8a1a79816532c58", "attempt_id": "b46fb5cfe4cc", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.614653Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 413, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.3319589998573, "ttft_ms": 11.778834043070674, "decode_ms": 11.786999995820224}, "total_wall_ms": 7088.82975007873, "ttft_ms": 11.778834043070674, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3549 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e55da20ffcdcfedbbd152b0f", "attempt_id": "20baf1b80cb6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:48.816194Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 427, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.74241700395942, "ttft_ms": 11.76379097159952, "decode_ms": 105.97279097419232}, "total_wall_ms": 7184.409208944999, "ttft_ms": 11.76379097159952, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3550 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "36267248c59b4bf66952492c", "attempt_id": "2d803970785d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.113299Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.74362504575402, "ttft_ms": 11.74829201772809, "decode_ms": 94.459000043571}, "total_wall_ms": 7172.85324994009, "ttft_ms": 11.74829201772809, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15828866", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "c9d49be6f876880a6dfe30589ff0b746c048ebaf1842118a883f5503a349a8b6"} | ||||
| 3551 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "455749589724001613fb9977", "attempt_id": "edf9e1a9d292", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.398808Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 430, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.61391602549702, "ttft_ms": 11.799250030890107, "decode_ms": 11.838750098831952}, "total_wall_ms": 7090.168667025864, "ttft_ms": 11.799250030890107, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3552 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "930fdfaeba90af289a75cb42", "attempt_id": "210167b42167", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.601819Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.16475009080023, "ttft_ms": 12.144459062255919, "decode_ms": 82.49591593630612}, "total_wall_ms": 7160.804915940389, "ttft_ms": 12.144459062255919, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6914937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "534d40ded32f784c68307dd2386faed2a27bf39dcc27321ee6985e42ccd285e5"} | ||||
| 3553 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c83c1e1d1b2d5fc9ed136f8b", "attempt_id": "b24ebe69d32d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.875452Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 420, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.4248330956325, "ttft_ms": 11.745458003133535, "decode_ms": 11.822083033621311}, "total_wall_ms": 7089.925166917965, "ttft_ms": 11.745458003133535, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3554 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a413e661e3f29a3499aa4cef", "attempt_id": "14096fe6c9a7", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:50.078611Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 423, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 162.6319580245763, "ttft_ms": 12.003249954432249, "decode_ms": 11.87183300498873}, "total_wall_ms": 7089.54525005538, "ttft_ms": 12.003249954432249, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3555 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "7d67252d68708916ce139c40", "attempt_id": "8b7a0833495b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:50.281170Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1955, "query_tokens": 425, "message_tokens": 329, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 6902.532499982044, "hops": {"1": 6902.532499982044}, "receiver_prefill_ms": 163.75304199755192, "ttft_ms": 11.849457980133593, "decode_ms": 11.84250006917864}, "total_wall_ms": 7090.372124919668, "ttft_ms": 11.849457980133593, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "a3bc07ae34a4f72dd11a6738ade8463df3fa03c063d19d58651b6ead2a13f850", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3556 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "32f0aea542e323974c082c53", "attempt_id": "56b00936af11", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.207317Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 401, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.11791701894253, "ttft_ms": 11.538624996319413, "decode_ms": 11.575874988920987}, "total_wall_ms": 10832.374625024386, "ttft_ms": 11.538624996319413, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3557 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "52e00003bf89a2dd0db49ee0", "attempt_id": "6c3e2fed0be6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.432105Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 408, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 187.07454099785537, "ttft_ms": 11.601374950259924, "decode_ms": 11.515165911987424}, "total_wall_ms": 10834.40662396606, "ttft_ms": 11.601374950259924, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3558 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "076477e095094cf954531adc", "attempt_id": "6feeefafeacf", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.658401Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 407, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.49241696018726, "ttft_ms": 11.523708933964372, "decode_ms": 11.476584011688828}, "total_wall_ms": 10832.613540929742, "ttft_ms": 11.523708933964372, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3559 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "80df95069eef4bba0c71069b", "attempt_id": "9441a5d15ba2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:54.883030Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 403, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.39558397606015, "ttft_ms": 11.498625040985644, "decode_ms": 103.44258300028741}, "total_wall_ms": 10924.560333020054, "ttft_ms": 11.498625040985644, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3560 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f7ef7c35ce0bb2b23a36107c", "attempt_id": "f85e1169a0c5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.198965Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 414, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 182.9623329686001, "ttft_ms": 11.450292076915503, "decode_ms": 11.449708021245897}, "total_wall_ms": 10829.991040984169, "ttft_ms": 11.450292076915503, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3561 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "47ba67bdea77540ff06ab780", "attempt_id": "ca09a65cbbf2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.420757Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 409, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 183.7443329859525, "ttft_ms": 11.527374968864024, "decode_ms": 11.427958030253649}, "total_wall_ms": 10830.80004202202, "ttft_ms": 11.527374968864024, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3562 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "b341bb9b289354fbbef778a0", "attempt_id": "efc9f2707e87", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.642982Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 403, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.20104193501174, "ttft_ms": 11.518582934513688, "decode_ms": 11.543250060640275}, "total_wall_ms": 10831.360082956962, "ttft_ms": 11.518582934513688, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3563 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "808fe4967e57b1088dbbd2fb", "attempt_id": "ff20fe126819", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:55.865367Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 403, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 186.58191699068993, "ttft_ms": 11.780000058934093, "decode_ms": 11.600499972701073}, "total_wall_ms": 10834.17795796413, "ttft_ms": 11.780000058934093, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3564 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f3fc6c39901c8b347be8d999", "attempt_id": "f48ff9ebe6c6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.090508Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 418, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.23929205164313, "ttft_ms": 11.577625060454011, "decode_ms": 57.389084016904235}, "total_wall_ms": 10877.343916916288, "ttft_ms": 11.577625060454011, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3565 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0fd7e8fcf4255c723aee3f42", "attempt_id": "271530ae39d2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.359377Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 411, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 187.27079196833074, "ttft_ms": 11.509082978591323, "decode_ms": 57.34191706869751}, "total_wall_ms": 10880.241040955298, "ttft_ms": 11.509082978591323, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,000,000", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "a8f19157bfa97ae9789ef71ec65944fe20e98491b7b0c2aa047d68bf92a3e7fd"} | ||||
| 3566 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "301fe2a9b9d7f0292e06b499", "attempt_id": "29911531c148", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.630954Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 419, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 181.3983329338953, "ttft_ms": 11.585332918912172, "decode_ms": 11.511708959005773}, "total_wall_ms": 10828.584041912109, "ttft_ms": 11.585332918912172, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3567 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d7600423fe9bb67750d9c6eb", "attempt_id": "736405ccda0f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:56.851089Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 414, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.55691705457866, "ttft_ms": 11.523167020641267, "decode_ms": 57.48795799445361}, "total_wall_ms": 10877.674916875549, "ttft_ms": 11.523167020641267, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3568 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d8a893b6b7b40dcd1750232b", "attempt_id": "087350c8c1a0", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:57.120063Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 410, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 185.09566702414304, "ttft_ms": 11.490083066746593, "decode_ms": 11.453374987468123}, "total_wall_ms": 10832.114374963567, "ttft_ms": 11.490083066746593, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3569 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "e26ea3805eb9a9309fe7295b", "attempt_id": "f92eeca785e2", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:57.343543Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 414, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 184.01579197961837, "ttft_ms": 11.505834059789777, "decode_ms": 11.486624949611723}, "total_wall_ms": 10831.102123949677, "ttft_ms": 11.505834059789777, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3570 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "8b7d6b742cbb2bab36003ae9", "attempt_id": "90cb0f935966", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h2", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:57.565991Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 416, "message_tokens": 299, "message_utf8_bytes": 856, "cache_tensor_bytes": null, "serialized_payload_bytes": 856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 10623.747832956724, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798}, "receiver_prefill_ms": 186.47879210766405, "ttft_ms": 11.604208033531904, "decode_ms": 11.550666997209191}, "total_wall_ms": 10833.764332928695, "ttft_ms": 11.604208033531904, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "ba14cf3ffcb23a84821d65b144b85efdb6c26697d433b2af58366827b4c8eba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3571 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "282648cc1ad692181a94033b", "attempt_id": "f3a7c9017338", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.145574Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 427, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.1518328981474, "ttft_ms": 11.601875070482492, "decode_ms": 11.466708034276962}, "total_wall_ms": 19182.455581845716, "ttft_ms": 11.601875070482492, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3572 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "2efd215d6f379713b19ef1c5", "attempt_id": "aac35836d7d5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.368425Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 434, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.1881669824943, "ttft_ms": 11.533332988619804, "decode_ms": 11.421707924455404}, "total_wall_ms": 19183.356457855552, "ttft_ms": 11.533332988619804, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3573 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a199f98122c4ea0436580d6e", "attempt_id": "b61ed8163389", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.591094Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 433, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.53512499015778, "ttft_ms": 11.808916926383972, "decode_ms": 11.57833298202604}, "total_wall_ms": 19183.29666578211, "ttft_ms": 11.808916926383972, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3574 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "ea875e8491bf9ad2111e80b0", "attempt_id": "a2079ddcb751", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.814222Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.72191698290408, "ttft_ms": 11.70645805541426, "decode_ms": 103.66066603455693}, "total_wall_ms": 19275.43687389698, "ttft_ms": 11.70645805541426, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3575 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "d1146bf9fbcb72926ca626e1", "attempt_id": "e942b88622b5", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.130065Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.64200000744313, "ttft_ms": 11.569666909053922, "decode_ms": 11.474541970528662}, "total_wall_ms": 19183.910374878906, "ttft_ms": 11.569666909053922, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3576 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c424cebb58afa5480b073e7a", "attempt_id": "8dbcf864c9ef", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.353743Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 435, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.20074989646673, "ttft_ms": 11.636749957688153, "decode_ms": 11.452458100393414}, "total_wall_ms": 19184.493873850442, "ttft_ms": 11.636749957688153, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3577 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0cf9fa8bf456be126d1a70ac", "attempt_id": "5bf132d61906", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.577705Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.41195897664875, "ttft_ms": 11.66979200206697, "decode_ms": 11.54587499331683}, "total_wall_ms": 19182.796790846623, "ttft_ms": 11.66979200206697, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3578 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "877dbce9aad6b105b61fbc39", "attempt_id": "7e1897b6ffb6", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.799523Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.62191596720368, "ttft_ms": 11.542417109012604, "decode_ms": 11.489874916151166}, "total_wall_ms": 19184.848331846297, "ttft_ms": 11.542417109012604, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3579 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9bf21bf5e9cd7b14dbf52c10", "attempt_id": "0a036e322eb1", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.023148Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 444, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.39075001515448, "ttft_ms": 11.536792037077248, "decode_ms": 57.62087507173419}, "total_wall_ms": 19229.782623820938, "ttft_ms": 11.536792037077248, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3580 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "4991735f0c6d669ddb410cc9", "attempt_id": "8c0d7c661a06", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.292353Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 437, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 183.92350000794977, "ttft_ms": 11.530791060067713, "decode_ms": 57.63629195280373}, "total_wall_ms": 19229.3029158609, "ttft_ms": 11.530791060067713, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,000,000", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "a8f19157bfa97ae9789ef71ec65944fe20e98491b7b0c2aa047d68bf92a3e7fd"} | ||||
| 3581 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c47c24168ce645996e58b291", "attempt_id": "46f84613dd6d", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.561144Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 445, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.29229098930955, "ttft_ms": 11.526333983056247, "decode_ms": 11.494959006085992}, "total_wall_ms": 19184.505624813028, "ttft_ms": 11.526333983056247, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3582 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "6393fcd54e83bd5591ea952e", "attempt_id": "b729ecb000cf", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:08.784875Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.37124998308718, "ttft_ms": 11.541667045094073, "decode_ms": 57.602541986852884}, "total_wall_ms": 19229.72504084464, "ttft_ms": 11.541667045094073, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3583 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9a916e02221f5f654f3ea10a", "attempt_id": "773b8ba96a14", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:09.054030Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 436, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 185.26408297475427, "ttft_ms": 11.60491700284183, "decode_ms": 11.488249991089106}, "total_wall_ms": 19184.685706859455, "ttft_ms": 11.60491700284183, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3584 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "fabb394ca93a9fb5207b7189", "attempt_id": "a9469949540a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:09.278464Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.82229195069522, "ttft_ms": 11.583750019781291, "decode_ms": 11.56625000294298}, "total_wall_ms": 19184.16024884209, "ttft_ms": 11.583750019781291, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3585 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "13d5741a3d04d8a6501b3f92", "attempt_id": "e7f662333103", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h4", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:09.502472Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 442, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 18975.824540830217, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292}, "receiver_prefill_ms": 184.81195799540728, "ttft_ms": 11.778416926972568, "decode_ms": 11.68158301152289}, "total_wall_ms": 19184.613832854666, "ttft_ms": 11.778416926972568, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3586 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "986b57137b9ce8fe0a232066", "attempt_id": "70d8121f81eb", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.075314Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 427, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 182.95579100959003, "ttft_ms": 11.527625028975308, "decode_ms": 11.49016700219363}, "total_wall_ms": 36526.62808180321, "ttft_ms": 11.527625028975308, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3587 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "68fc80b4320f08c4739af3c0", "attempt_id": "a65a82a1bf8f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.297865Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 434, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 182.6196250040084, "ttft_ms": 11.574708973057568, "decode_ms": 11.532500036992133}, "total_wall_ms": 36526.34958282579, "ttft_ms": 11.574708973057568, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3588 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "af761bf2968d73dc291319e3", "attempt_id": "d4da182e198a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.519735Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 433, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.0052910372615, "ttft_ms": 11.547958012670279, "decode_ms": 11.56937493942678}, "total_wall_ms": 36526.74520784058, "ttft_ms": 11.547958012670279, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3589 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "31f6324d4005a81bb6e87b23", "attempt_id": "f5958669933b", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:27.742047Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.25354093778878, "ttft_ms": 11.528333998285234, "decode_ms": 103.85308298282325}, "total_wall_ms": 36620.2802908374, "ttft_ms": 11.528333998285234, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 3590 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "a23ad7ecff07967e17a704de", "attempt_id": "20564f11cdaa", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.057282Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.3003750545904, "ttft_ms": 11.527125025168061, "decode_ms": 11.529542040079832}, "total_wall_ms": 36527.97053998802, "ttft_ms": 11.527125025168061, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3591 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "0030acdb6dbf81d0d87ea3c8", "attempt_id": "aff3b9c61732", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.280243Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 435, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 186.0141250072047, "ttft_ms": 11.580625083297491, "decode_ms": 11.531542055308819}, "total_wall_ms": 36529.73383292556, "ttft_ms": 11.580625083297491, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3592 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "3c1b90a9dc1fe77b57325b3f", "attempt_id": "de5809ce296a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.505046Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.01004194654524, "ttft_ms": 11.83879200834781, "decode_ms": 11.49150007404387}, "total_wall_ms": 36526.95266494993, "ttft_ms": 11.83879200834781, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3593 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "702bd4b1cb5dcffaa41e0b10", "attempt_id": "e37327299fcf", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.726653Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 429, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.0625410657376, "ttft_ms": 11.526082991622388, "decode_ms": 11.536041973158717}, "total_wall_ms": 36526.72833192628, "ttft_ms": 11.526082991622388, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3594 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f42418df841e1cee7a2ba592", "attempt_id": "41382625009e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:28.947685Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 444, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.81733393855393, "ttft_ms": 11.634916998445988, "decode_ms": 57.519542053341866}, "total_wall_ms": 36574.61024890654, "ttft_ms": 11.634916998445988, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3595 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "9ff142be453fac0f188c51ee", "attempt_id": "6a004181a6b0", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.216944Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 437, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.62754203937948, "ttft_ms": 11.469374992884696, "decode_ms": 57.3348329635337}, "total_wall_ms": 36574.054081807844, "ttft_ms": 11.469374992884696, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,000,000", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "a8f19157bfa97ae9789ef71ec65944fe20e98491b7b0c2aa047d68bf92a3e7fd"} | ||||
| 3596 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "da71969e078df5a4d0ace118", "attempt_id": "95f02332134a", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.485706Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 445, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.98929201066494, "ttft_ms": 11.605625040829182, "decode_ms": 11.454334016889334}, "total_wall_ms": 36527.655539801344, "ttft_ms": 11.605625040829182, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3597 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "523abb46c407a1c204e938ad", "attempt_id": "552d6ea44f3e", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.709208Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 185.88920799084008, "ttft_ms": 11.528583010658622, "decode_ms": 57.80966591555625}, "total_wall_ms": 36575.850290828384, "ttft_ms": 11.528583010658622, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,914,937", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "c56851abfdbf8851226a1e71c4911c616a691c490a883eb754e61bac551d004c"} | ||||
| 3598 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "42189f91a606656db2179f32", "attempt_id": "b61e496c6038", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.980312Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 436, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.3075419999659, "ttft_ms": 11.470124940387905, "decode_ms": 11.47279201541096}, "total_wall_ms": 36526.87003987376, "ttft_ms": 11.470124940387905, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3599 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "c33c52f5ed4bda6114c830fb", "attempt_id": "d864585fea94", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:30.202414Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 440, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 184.77762502152473, "ttft_ms": 11.464999988675117, "decode_ms": 11.751624988391995}, "total_wall_ms": 36528.57462386601, "ttft_ms": 11.464999988675117, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 3600 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_core", "trial_id": "f0e6ff093389e04dd8275310", "attempt_id": "2c20470b933f", "run_group_id": "E4_core:A5|closed|qwen3b-llama3b:h8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5b97ab3cef5587ee7db07b92390e2e3a28a0afee1c30cea111c3a46c9554433b", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:30.425778Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11|mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96b-m3ultra-96g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b", "llama3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 8, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1760, "query_tokens": 442, "message_tokens": 325, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 36320.24874887429, "hops": {"1": 6902.532499982044, "2": 3721.2153329746798, "3": 4287.0670419652015, "4": 4065.009665908292, "5": 4598.389083053917, "6": 4072.139750001952, "7": 4599.793374887668, "8": 4074.102000100538}, "receiver_prefill_ms": 183.4474999923259, "ttft_ms": 11.52937498409301, "decode_ms": 11.499374988488853}, "total_wall_ms": 36527.099415892735, "ttft_ms": 11.52937498409301, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "ledger_by_hop": {"1": {"facts_total": 63, "facts_retained": 9, "retention_rate": 0.14285714285714285, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.25, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 787}, "2": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "3": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 816}, "4": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "5": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "6": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "7": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}, "8": {"facts_total": 63, "facts_retained": 12, "retention_rate": 0.19047619047619047, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07692307692307693, "status": 0.5, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 923}}}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_core.log", "payload_hash": "3e25d9c439f55699f2305c8554c1cca0a9a3f39bbfef22b0c8d64ebbde2b63e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
modified
src/wp30/analysis/analyze.py
+50 −20
@@ -43,7 +43,7 @@ def table_primary(df: pd.DataFrame, exp: str, sources: list[str]) -> pd.DataFram | |||||
| 43 | rows.append({"family": fam, "pair": pair, "condition": cond, "method": g["method_id"].iloc[0], "access": g["question_access"].iloc[0], "n": q["n"], "n_docs": q["n_clusters"], | 43 | rows.append({"family": fam, "pair": pair, "condition": cond, "method": g["method_id"].iloc[0], "access": g["question_access"].iloc[0], "n": q["n"], "n_docs": q["n_clusters"], | ||
| 44 | "quality": q["mean"], "q_lo": q["lo"], "q_hi": q["hi"], "success_rate": ok, "payload_bytes_median": g["serialized_payload_bytes"].median(), | 44 | "quality": q["mean"], "q_lo": q["lo"], "q_hi": q["hi"], "success_rate": ok, "payload_bytes_median": g["serialized_payload_bytes"].median(), | ||
| 45 | "cache_bytes_median": g["cache_tensor_bytes"].median(), "cold_ms_p50": g["cost_cold_ms"].median(), "warm_ms_p50": g["cost_warm_query_ms"].median(), | 45 | "cache_bytes_median": g["cache_tensor_bytes"].median(), "cold_ms_p50": g["cost_cold_ms"].median(), "warm_ms_p50": g["cost_warm_query_ms"].median(), | ||
| 46 | − "amortized_ms_p50": g["cost_amortized_ms"].median(), "ttft_ms_p50": g["ttft_ms"].median(), "peak_decode_mem_median": g["peak_decode_memory"].median(), | 46 | + "amortized_ms_p50": g["cost_amortized_ms"].median(), "ttft_ms_p50": g["ttft_ms"].median(), "peak_decode_mem_median": g["peak_decode_memory"].median(), "peak_cold_mem_median": g["peak_memory_cold"].median(), | ||
| 47 | "fetched_bytes_mean": g["fetched_bytes"].mean()}) | 47 | "fetched_bytes_mean": g["fetched_bytes"].mean()}) | ||
| 48 | t = pd.DataFrame(rows).sort_values(["family", "pair", "condition"]) | 48 | t = pd.DataFrame(rows).sort_values(["family", "pair", "condition"]) | ||
| 49 | TAB.mkdir(parents=True, exist_ok=True); p = TAB / f"{exp}_primary.csv"; t.to_csv(p, index=False); _prov(p, sources, "per-condition quality (cluster bootstrap CI) and resource medians") | 49 | TAB.mkdir(parents=True, exist_ok=True); p = TAB / f"{exp}_primary.csv"; t.to_csv(p, index=False); _prov(p, sources, "per-condition quality (cluster bootstrap CI) and resource medians") | ||
@@ -107,57 +107,68 @@ def fig_quality_vs_bytes(df: pd.DataFrame, exp: str, sources, access_filter=None | |||||
| 107 | 107 | ||||
| 108 | def fig_quality_vs_latency(df: pd.DataFrame, exp: str, sources, name="fig3_quality_vs_latency_memory"): | 108 | def fig_quality_vs_latency(df: pd.DataFrame, exp: str, sources, name="fig3_quality_vs_latency_memory"): | ||
| 109 | _style() | 109 | _style() | ||
| 110 | + from matplotlib.ticker import NullFormatter | ||||
| 111 | + df = df[(df["hardware_id"] == "laptop-m5max-48g") & (df["pair"].str.startswith("Qwen"))] # one machine, one pair: comparable timings | ||||
| 110 | fams = [f for f in ["synthetic", "exec", "public_qasper", "public_2wikimqa"] if f in set(df["task_family"])] | 112 | fams = [f for f in ["synthetic", "exec", "public_qasper", "public_2wikimqa"] if f in set(df["task_family"])] | ||
| 111 | − fig, axes = plt.subplots(2, len(fams), figsize=(3.1 * len(fams), 5.2), squeeze=False) | 113 | + fig, axes = plt.subplots(2, len(fams), figsize=(3.1 * len(fams), 5.6), squeeze=False) | ||
| 112 | for j, fam in enumerate(fams): | 114 | for j, fam in enumerate(fams): | ||
| 113 | d = df[df["task_family"] == fam] | 115 | d = df[df["task_family"] == fam] | ||
| 114 | for cond, g in d.groupby("condition"): | 116 | for cond, g in d.groupby("condition"): | ||
| 115 | m = g["method_id"].iloc[0]; q = g["quality_operational"].mean() | 117 | m = g["method_id"].iloc[0]; q = g["quality_operational"].mean() | ||
| 116 | if m == "A0": continue | 118 | if m == "A0": continue | ||
| 117 | axes[0][j].scatter(g["cost_cold_ms"].median(), q, marker=_mk(m, g["bits"].iloc[0]), color=METHOD_COLOR.get(m, "#444"), s=22, facecolors="white" if m.startswith("B") else METHOD_COLOR.get(m, "#444"), lw=0.9) | 119 | axes[0][j].scatter(g["cost_cold_ms"].median(), q, marker=_mk(m, g["bits"].iloc[0]), color=METHOD_COLOR.get(m, "#444"), s=22, facecolors="white" if m.startswith("B") else METHOD_COLOR.get(m, "#444"), lw=0.9) | ||
| 118 | − axes[1][j].scatter(g["peak_decode_memory"].median() / 1e9, q, marker=_mk(m, g["bits"].iloc[0]), color=METHOD_COLOR.get(m, "#444"), s=22, facecolors="white" if m.startswith("B") else METHOD_COLOR.get(m, "#444"), lw=0.9) | 120 | + axes[1][j].scatter(g["peak_memory_cold"].median() / 1e9, q, marker=_mk(m, g["bits"].iloc[0]), color=METHOD_COLOR.get(m, "#444"), s=22, facecolors="white" if m.startswith("B") else METHOD_COLOR.get(m, "#444"), lw=0.9) | ||
| 119 | − axes[0][j].set_xscale("log"); axes[0][j].set_title(fam.replace("public_", ""), fontsize=8.5); axes[0][j].set_xlabel("cold end-to-end latency, ms (log)"); axes[1][j].set_xlabel("peak MLX memory during trial, GB") | 121 | + axes[0][j].set_xscale("log"); axes[0][j].xaxis.set_minor_formatter(NullFormatter()); axes[0][j].set_title(fam.replace("public_", ""), fontsize=8.5); axes[0][j].set_xlabel("cold latency, ms (log)"); axes[1][j].set_xlabel("peak MLX memory incl. build, GB") | ||
| 120 | axes[0][j].set_ylim(-0.03, 1.03); axes[1][j].set_ylim(-0.03, 1.03) | 122 | axes[0][j].set_ylim(-0.03, 1.03); axes[1][j].set_ylim(-0.03, 1.03) | ||
| 121 | axes[0][0].set_ylabel("quality"); axes[1][0].set_ylabel("quality") | 123 | axes[0][0].set_ylabel("quality"); axes[1][0].set_ylabel("quality") | ||
| 122 | − fig.suptitle("Quality vs cold latency (top) and peak memory (bottom); all model pairs pooled", fontsize=9.5) | 124 | + present = set(df["method_id"]) | ||
| 125 | + handles = [plt.Line2D([], [], marker=_mk(m, None), color=METHOD_COLOR[m], ls="", ms=5, mfc="white" if m.startswith("B") else None, label=LABELS[m] + (" 8-bit" if m == "B2" else "")) for m in ["A1", "A2", "A3", "A4", "A5", "A6", "A7", "A8", "B0", "B1", "B2", "B3", "B4", "B5", "B6", "B9"] if m in present] | ||||
| 126 | + if ((df["method_id"] == "B2") & (df["bits"] == 4)).any(): handles.append(plt.Line2D([], [], marker="p", color=METHOD_COLOR["B2"], ls="", ms=5, mfc="white", label="B2 packed quant 4-bit")) | ||||
| 127 | + fig.legend(handles=handles, loc="lower center", ncol=6, fontsize=7, bbox_to_anchor=(0.5, -0.07)) | ||||
| 128 | + fig.subplots_adjust(hspace=0.45) | ||||
| 129 | + fig.suptitle("Quality vs cold latency (top) and peak MLX memory (bottom) - Qwen2.5-3B pair on the laptop (models resident: ~6.5 GB baseline)", fontsize=9) | ||||
| 123 | _save_fig(fig, name, sources) | 130 | _save_fig(fig, name, sources) | ||
| 124 | 131 | ||||
| 125 | def fig_latency_decomposition(df: pd.DataFrame, exp: str, sources, name="fig4_latency_decomposition"): | 132 | def fig_latency_decomposition(df: pd.DataFrame, exp: str, sources, name="fig4_latency_decomposition"): | ||
| 126 | _style() | 133 | _style() | ||
| 127 | − d = df[(df["task_family"] == "synthetic") & (df["status"] == "success")] | 134 | + d = df[(df["task_family"] == "synthetic") & (df["status"] == "success") & (df["hardware_id"] == "laptop-m5max-48g") & (df["pair"].str.startswith("Qwen"))] | ||
| 128 | − conds = [c for c in ["A1", "A4|budget_tokens=512|blind", "A5|budget_tokens=512|blind", "A7|codec=zstd", "B0", "B1", "B2|bits=8", "B3|keep_frac=0.25", "B5|keep_frac=0.25|aware"] if c in set(d["condition"])] | 135 | + conds = [c for c in ["A1", "A3|budget_tokens=512|aware", "A4|budget_tokens=512|blind", "A5|budget_tokens=512|blind", "A7|codec=zstd", "A8|budget_tokens=512|blind", "B0", "B1", "B2|bits=8", "B3|keep_frac=0.25", "B5|keep_frac=0.25|aware", "B6|keep_frac=0.25|aware"] if c in set(d["condition"])] | ||
| 129 | comps = [("span_encode_ms", "sender encode (text)"), ("span_doc_prefill_ms", "document prefill (cache)"), ("span_compress_ms", "compress/select"), ("span_serialize_ms", "serialize"), ("span_load_ms", "deserialize/load"), ("span_receiver_prefill_ms", "receiver prefill"), ("ttft_ms", "query prefill→first token"), ("span_decode_ms", "decode")] | 136 | comps = [("span_encode_ms", "sender encode (text)"), ("span_doc_prefill_ms", "document prefill (cache)"), ("span_compress_ms", "compress/select"), ("span_serialize_ms", "serialize"), ("span_load_ms", "deserialize/load"), ("span_receiver_prefill_ms", "receiver prefill"), ("ttft_ms", "query prefill→first token"), ("span_decode_ms", "decode")] | ||
| 130 | cols = ["#2a78d6", "#6250d6", "#1baf7a", "#eda100", "#e87ba4", "#eb6834", "#008300", "#7a7a78"] | 137 | cols = ["#2a78d6", "#6250d6", "#1baf7a", "#eda100", "#e87ba4", "#eb6834", "#008300", "#7a7a78"] | ||
| 131 | − fig, ax = plt.subplots(figsize=(7.2, 3.2)) | 138 | + fig, ax = plt.subplots(figsize=(7.2, 3.8)) | ||
| 132 | for i, c in enumerate(conds): | 139 | for i, c in enumerate(conds): | ||
| 133 | g = d[d["condition"] == c]; left = 0 | 140 | g = d[d["condition"] == c]; left = 0 | ||
| 134 | for (col, lab), color in zip(comps, cols): | 141 | for (col, lab), color in zip(comps, cols): | ||
| 142 | + if col == "span_encode_ms" and c.startswith("B"): | ||||
| 143 | + continue # for cache methods the encode span is the sum of the components plotted separately | ||||
| 135 | v = g[col].median() if col in g and g[col].notna().any() else 0.0 | 144 | v = g[col].median() if col in g and g[col].notna().any() else 0.0 | ||
| 136 | if v and v > 0: | 145 | if v and v > 0: | ||
| 137 | − ax.barh(i, v, left=left, color=color, height=0.6, label=lab if i == 0 else None, edgecolor="white", linewidth=0.8); left += v | 146 | + ax.barh(i, v, left=left, color=color, height=0.6, edgecolor="white", linewidth=0.8); left += v | ||
| 138 | ax.set_yticks(range(len(conds))); ax.set_yticklabels([c.replace("|", " ") for c in conds], fontsize=7.5); ax.invert_yaxis(); ax.set_xlabel("median span duration, ms (serial accounting; one question per document build)") | 147 | ax.set_yticks(range(len(conds))); ax.set_yticklabels([c.replace("|", " ") for c in conds], fontsize=7.5); ax.invert_yaxis(); ax.set_xlabel("median span duration, ms (serial accounting; one question per document build)") | ||
| 139 | − ax.legend(fontsize=7, ncol=4, loc="lower right"); ax.set_title("Latency decomposition — synthetic, cold scenario (document build counted once)", fontsize=9) | 148 | + ax.legend(handles=[plt.Rectangle((0, 0), 1, 1, color=c) for c in cols], labels=[lab for _, lab in comps], fontsize=7, ncol=4, loc="upper center", bbox_to_anchor=(0.5, -0.22)); ax.set_title("Latency decomposition - synthetic family, Qwen2.5-3B on the laptop, cold scenario (document build counted once)", fontsize=8.5) | ||
| 140 | _save_fig(fig, name, sources) | 149 | _save_fig(fig, name, sources) | ||
| 141 | 150 | ||||
| 142 | def fig_handoffs(df: pd.DataFrame, exp: str, sources, name="fig5_handoffs"): | 151 | def fig_handoffs(df: pd.DataFrame, exp: str, sources, name="fig5_handoffs"): | ||
| 143 | _style() | 152 | _style() | ||
| 144 | d = df[df["topology"].astype(str).str.startswith("chain")] | 153 | d = df[df["topology"].astype(str).str.startswith("chain")] | ||
| 145 | if d.empty: return | 154 | if d.empty: return | ||
| 146 | − fig, axes = plt.subplots(1, 3, figsize=(9.6, 2.8)) | 155 | + fig, axes = plt.subplots(1, 3, figsize=(9.6, 3.4)) | ||
| 147 | − for cid, g in d.groupby("run_group_id"): | ||||
| 148 | − pass | ||||
| 149 | d["chain"] = d["run_group_id"].str.split(":").str[1] | 156 | d["chain"] = d["run_group_id"].str.split(":").str[1] | ||
| 150 | for chain, g in d.groupby("chain"): | 157 | for chain, g in d.groupby("chain"): | ||
| 151 | − rep = g["method_id"].iloc[0]; mode = g["topology"].iloc[0].replace("chain_", "") | 158 | + rep = g["method_id"].iloc[0]; mode = g["topology"].iloc[0].replace("chain_", ""); agents = chain.split("|")[-1] | ||
| 152 | − color = "#eda100" if rep == "A5" else "#2a78d6"; ls = "-" if mode == "closed" else "--" | 159 | + alt = "-" in agents | ||
| 160 | + color = "#eda100" if rep == "A5" else "#2a78d6"; ls = "-" if mode == "closed" else "--"; mk = "s" if alt else "o" | ||||
| 153 | hop = g.groupby("handoff_index") | 161 | hop = g.groupby("handoff_index") | ||
| 154 | ret = hop["retention_rate"].mean(); uns = hop["unsupported"].mean(); acc = hop["quality_operational"].mean() | 162 | ret = hop["retention_rate"].mean(); uns = hop["unsupported"].mean(); acc = hop["quality_operational"].mean() | ||
| 155 | − axes[0].plot(ret.index, ret.values, ls, color=color, marker="o", ms=4, label=f"{rep} {mode}") | 163 | + lab = f"{rep} {mode}" + (" (Qwen/Llama alternating)" if alt else " (Qwen)") | ||
| 156 | − axes[1].plot(uns.index, uns.values, ls, color=color, marker="o", ms=4) | 164 | + axes[0].plot(ret.index, ret.values, ls, color=color, marker=mk, ms=4, label=lab, mfc="white" if alt else None) | ||
| 157 | − axes[2].plot(acc.index, acc.values, ls, color=color, marker="o", ms=4) | 165 | + axes[1].plot(uns.index, uns.values, ls, color=color, marker=mk, ms=4, mfc="white" if alt else None) | ||
| 158 | − for ax, t in zip(axes, ["retained correct facts (ledger)", "unsupported numbers + identifiers per message", "question accuracy from message"]): | 166 | + axes[2].plot(acc.index, acc.values, ls, color=color, marker=mk, ms=4, mfc="white" if alt else None) | ||
| 167 | + for ax, t in zip(axes, ["retained ledger facts (share of 62)", "unsupported numbers/ids per message", "answer accuracy (15 question types)"]): | ||||
| 159 | ax.set_xlabel("handoffs"); ax.set_title(t, fontsize=8.5); ax.set_xticks(sorted(d["handoff_index"].unique())) | 168 | ax.set_xlabel("handoffs"); ax.set_title(t, fontsize=8.5); ax.set_xticks(sorted(d["handoff_index"].unique())) | ||
| 160 | − axes[0].set_ylim(0, 1.02); axes[2].set_ylim(0, 1.02); axes[0].legend(fontsize=7) | 169 | + axes[0].set_ylim(0, 1.02); axes[2].set_ylim(0, 1.02); axes[1].set_ylim(0, 0.3) | ||
| 170 | + fig.subplots_adjust(bottom=0.3, wspace=0.3) | ||||
| 171 | + fig.legend(*axes[0].get_legend_handles_labels(), loc="lower center", ncol=3, fontsize=7, bbox_to_anchor=(0.5, 0.0)) | ||||
| 161 | _save_fig(fig, name, sources, "means over documents; chains defined in configs/chains*.yaml") | 172 | _save_fig(fig, name, sources, "means over documents; chains defined in configs/chains*.yaml") | ||
| 162 | 173 | ||||
| 163 | def fig_breakeven(net_rows: list[dict], exp: str, sources, name="fig6_breakeven"): | 174 | def fig_breakeven(net_rows: list[dict], exp: str, sources, name="fig6_breakeven"): | ||
@@ -263,6 +274,25 @@ def main(protocol_path: str) -> int: | |||||
| 263 | q = cluster_bootstrap_mean(g, "quality_operational", n_boot=500) | 274 | q = cluster_bootstrap_mean(g, "quality_operational", n_boot=500) | ||
| 264 | rows.append({"family": fam, "provider_model": recv, "condition": cond, "quality": q["mean"], "lo": q["lo"], "hi": q["hi"], "n": q["n"], "cost_usd_mean": g["cost_usd"].mean(), "ttft_ms_p50": g["ttft_ms"].median(), "total_ms_p50": g["total_wall_ms"].median(), "success_rate": (g["status"] == "success").mean()}) | 275 | rows.append({"family": fam, "provider_model": recv, "condition": cond, "quality": q["mean"], "lo": q["lo"], "hi": q["hi"], "n": q["n"], "cost_usd_mean": g["cost_usd"].mean(), "ttft_ms_p50": g["ttft_ms"].median(), "total_ms_p50": g["total_wall_ms"].median(), "success_rate": (g["status"] == "success").mean()}) | ||
| 265 | t = pd.DataFrame(rows); p = TAB / "ED_hosted.csv"; t.to_csv(p, index=False); _prov(p, src, "hosted receivers; cost estimated from provider price tables") | 276 | t = pd.DataFrame(rows); p = TAB / "ED_hosted.csv"; t.to_csv(p, index=False); _prov(p, src, "hosted receivers; cost estimated from provider price tables") | ||
| 277 | + if "E7_qtypes" in exps: | ||||
| 278 | + d7 = load_experiments(["E7_qtypes.jsonl"]); src7 = ["runs/raw/E7_qtypes.jsonl"] | ||||
| 279 | + rows = [] | ||||
| 280 | + for (cond, qt, pair), g in d7.groupby(["condition", "qtype", "pair"]): | ||||
| 281 | + q = cluster_bootstrap_mean(g, "quality_operational", n_boot=500); rows.append({"condition": cond, "qtype": qt, "pair": _short_pair(pair), "quality": q["mean"], "lo": q["lo"], "hi": q["hi"], "n": q["n"], "abstained": g["abstained"].mean()}) | ||||
| 282 | + t7 = pd.DataFrame(rows); p = TAB / "E7_qtypes.csv"; t7.to_csv(p, index=False); _prov(p, src7, "EXPLORATORY: question types 6-15 on synthetic test documents") | ||||
| 283 | + _style(); fig, axes = plt.subplots(1, 2, figsize=(9.4, 3.4), sharey=True) | ||||
| 284 | + qorder = ["negation", "revision", "temporal", "aggregation", "unit_conversion", "unanswerable"] | ||||
| 285 | + for ax, pair in zip(axes, sorted(t7["pair"].unique())): | ||||
| 286 | + d = t7[t7["pair"] == pair] | ||||
| 287 | + conds = [c for c in ["A1", "A3|budget_tokens=512|blind", "A4|budget_tokens=512|blind", "A5|budget_tokens=512|blind", "B2|bits=8", "B3|keep_frac=0.25", "B5|keep_frac=0.25|aware"] if c in set(d["condition"])] | ||||
| 288 | + w = 0.8 / max(1, len(conds)); x = np.arange(len(qorder)) | ||||
| 289 | + for i, c in enumerate(conds): | ||||
| 290 | + m = c.split("|")[0]; vals = [d[(d["condition"] == c) & (d["qtype"] == qt)]["quality"].mean() if ((d["condition"] == c) & (d["qtype"] == qt)).any() else np.nan for qt in qorder] | ||||
| 291 | + ax.bar(x + (i - len(conds) / 2 + 0.5) * w, vals, w, color=METHOD_COLOR.get(m, "#444"), alpha=0.95 if c in ("A1", "A4|budget_tokens=512|blind", "A5|budget_tokens=512|blind") else 0.6, edgecolor="white", linewidth=0.5, label=LABELS.get(m, m) + (" 8-bit" if m == "B2" else "") + (" (aware)" if "aware" in c else "")) | ||||
| 292 | + ax.set_xticks(x); ax.set_xticklabels([q.replace("_", "\n") for q in qorder], fontsize=7.5); ax.set_title(f"{pair}", fontsize=8.5); ax.set_ylim(0, 1.02) | ||||
| 293 | + axes[0].set_ylabel("accuracy"); axes[0].legend(fontsize=6.5, ncol=2, loc="upper center", bbox_to_anchor=(1.05, -0.2)) | ||||
| 294 | + fig.suptitle("EXPLORATORY E7: question types not covered by the core (synthetic test, 40 documents)", fontsize=9) | ||||
| 295 | + _save_fig(fig, "figA_qtypes_exploratory", src7, "exploratory extension A-004") | ||||
| 266 | r8 = TAB / "E8_router_summary.csv" | 296 | r8 = TAB / "E8_router_summary.csv" | ||
| 267 | if r8.exists(): | 297 | if r8.exists(): | ||
| 268 | _style(); S = pd.read_csv(r8) | 298 | _style(); S = pd.read_csv(r8) | ||
modified
src/wp30/analysis/latex_tables.py
+28 −0
@@ -28,6 +28,34 @@ def main(): | |||||
| 28 | t2 = pd.read_csv(TAB / "table2_models.csv")[["alias", "repo", "revision", "layers", "kv_heads", "q_heads", "head_dim", "max_pos", "cache_bytes_per_token_bf16", "prefill_ms_8k", "prefill_ms_16k"]] | 28 | t2 = pd.read_csv(TAB / "table2_models.csv")[["alias", "repo", "revision", "layers", "kv_heads", "q_heads", "head_dim", "max_pos", "cache_bytes_per_token_bf16", "prefill_ms_8k", "prefill_ms_16k"]] | ||
| 29 | t2.columns = ["alias", "checkpoint", "rev.", "L", "H_kv", "H_q", "d_h", "max pos", "cache B/token", "prefill 8k", "prefill 16k"]; df_to_tex(t2, OUT / "table2_models.tex", "llllllllrrr") | 29 | t2.columns = ["alias", "checkpoint", "rev.", "L", "H_kv", "H_q", "d_h", "max pos", "cache B/token", "prefill 8k", "prefill 16k"]; df_to_tex(t2, OUT / "table2_models.tex", "llllllllrrr") | ||
| 30 | t3 = pd.read_csv(TAB / "table3_datasets.csv"); df_to_tex(t3, OUT / "table3_datasets.tex", "llrrr", "{:.0f}") | 30 | t3 = pd.read_csv(TAB / "table3_datasets.csv"); df_to_tex(t3, OUT / "table3_datasets.tex", "llrrr", "{:.0f}") | ||
| 31 | + pr = TAB / "E1_core_primary.csv" | ||||
| 32 | + if pr.exists(): | ||||
| 33 | + tp = pd.read_csv(pr) | ||||
| 34 | + tp["pair_s"] = tp["pair"].map({"Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16": "Qwen", "Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16": "Llama"}).fillna(tp["pair"]) | ||||
| 35 | + tp["fam_s"] = tp["family"].str.replace("public_", "") | ||||
| 36 | + tp["cell"] = tp.apply(lambda r: f"{100*r.quality:.0f} [{100*r.q_lo:.0f},{100*r.q_hi:.0f}]", axis=1) | ||||
| 37 | + tp["cond_s"] = tp["condition"].str.replace("budget_tokens=512", "512", regex=False).str.replace("keep_frac=0.25", "1/4", regex=False).str.replace("|max_fetch_bytes=2000|max_lookups=6", "", regex=False).str.replace("policy=attention", "att", regex=False).str.replace("codec=zstd", "zstd", regex=False).str.replace("|", " ", regex=False) | ||||
| 38 | + piv = tp.pivot_table(index="cond_s", columns=["fam_s", "pair_s"], values="cell", aggfunc="first") | ||||
| 39 | + piv = piv.reindex(columns=[(f, p) for f in ["synthetic", "exec", "qasper", "2wikimqa"] for p in ["Qwen", "Llama"]]) | ||||
| 40 | + piv.columns = [f"{f} {p}" for f, p in piv.columns] | ||||
| 41 | + order = sorted(piv.index, key=lambda c: (c[0], c)) | ||||
| 42 | + piv = piv.loc[order].reset_index().rename(columns={"cond_s": "condition"}).fillna("--") | ||||
| 43 | + df_to_tex(piv, OUT / "table_primary.tex", "l" + "r" * (len(piv.columns) - 1)) | ||||
| 44 | + hh = TAB / "E4_core_handoffs.csv" | ||||
| 45 | + if hh.exists(): | ||||
| 46 | + th = pd.read_csv(hh) | ||||
| 47 | + th["chain_s"] = th["chain"].str.replace("qwen3b-llama3b", "Qwen/Llama alt.", regex=False).str.replace("qwen3b", "Qwen", regex=False).str.replace("|", " ", regex=False) | ||||
| 48 | + th["accuracy_ci"] = th.apply(lambda r: f"{100*r.accuracy:.0f} [{100*r.acc_lo:.0f},{100*r.acc_hi:.0f}]", axis=1) | ||||
| 49 | + th["retention_ci"] = th.apply(lambda r: f"{100*r.retention:.0f} [{100*r.ret_lo:.0f},{100*r.ret_hi:.0f}]", axis=1) | ||||
| 50 | + out = th[["chain_s", "handoffs", "accuracy_ci", "retention_ci", "unsupported_mean", "msg_bytes_mean", "fetched_bytes_mean"]].rename(columns={"chain_s": "chain", "accuracy_ci": "accuracy (\\%)", "retention_ci": "retained facts (\\%)", "unsupported_mean": "unsupported/msg", "msg_bytes_mean": "message B", "fetched_bytes_mean": "fetched B"}) | ||||
| 51 | + df_to_tex(out, OUT / "table_handoffs.tex", "llrrrrr", "{:,.2f}") | ||||
| 52 | + ff = TAB / "E5_core_fanin.csv" | ||||
| 53 | + if ff.exists(): | ||||
| 54 | + tf = pd.read_csv(ff) | ||||
| 55 | + tf["cell"] = tf.apply(lambda r: f"{100*r.quality:.0f} [{100*r.lo:.0f},{100*r.hi:.0f}]", axis=1) | ||||
| 56 | + tf["method"] = tf["condition"].str.replace("|k=", " k=", regex=False).str.replace("cache_concat_negative_control", "cache concat (neg. control)", regex=False).str.replace("_", " ", regex=False) | ||||
| 57 | + piv = tf.pivot_table(index="method", columns="qtype", values="cell", aggfunc="first").reset_index().fillna("--") | ||||
| 58 | + df_to_tex(piv, OUT / "table_fanin.tex", "l" + "r" * (len(piv.columns) - 1)) | ||||
| 31 | h = TAB / "ED_hosted.csv" | 59 | h = TAB / "ED_hosted.csv" | ||
| 32 | if h.exists(): | 60 | if h.exists(): | ||
| 33 | th = pd.read_csv(h) | 61 | th = pd.read_csv(h) | ||
modified
src/wp30/analysis/load.py
+3 −1
@@ -51,7 +51,7 @@ def flatten(r: dict) -> dict: | |||||
| 51 | sc = r.get("task_scores") or {} | 51 | sc = r.get("task_scores") or {} | ||
| 52 | cc = r.get("compression_config") or {} | 52 | cc = r.get("compression_config") or {} | ||
| 53 | out = {k: r.get(k) for k in ["experiment_id", "trial_id", "attempt_id", "timestamp_utc", "run_group_id", "task_family", "document_id", "question_id", "split", "cluster_id", "method_id", | 53 | out = {k: r.get(k) for k in ["experiment_id", "trial_id", "attempt_id", "timestamp_utc", "run_group_id", "task_family", "document_id", "question_id", "split", "cluster_id", "method_id", | ||
| 54 | − "question_access", "topology", "handoff_index", "reuse_count", "status", "error_code", "serialized_payload_bytes", "message_utf8_bytes", | 54 | + "question_access", "topology", "handoff_index", "hardware_id", "reuse_count", "status", "error_code", "serialized_payload_bytes", "message_utf8_bytes", | ||
| 55 | "cache_tensor_bytes", "fetched_bytes", "total_wall_ms", "ttft_ms", "peak_prefill_memory", "peak_decode_memory", "prediction_artifact", "protocol_hash"]} | 55 | "cache_tensor_bytes", "fetched_bytes", "total_wall_ms", "ttft_ms", "peak_prefill_memory", "peak_decode_memory", "prediction_artifact", "protocol_hash"]} | ||
| 56 | out["sender"] = (r.get("sender_model_revision") or "").split("@")[0].split("/")[-1] | 56 | out["sender"] = (r.get("sender_model_revision") or "").split("@")[0].split("/")[-1] | ||
| 57 | out["receiver"] = (r.get("receiver_model_revision") or "").split("@")[0].split("/")[-1] | 57 | out["receiver"] = (r.get("receiver_model_revision") or "").split("@")[0].split("/")[-1] | ||
@@ -70,6 +70,8 @@ def flatten(r: dict) -> dict: | |||||
| 70 | if isinstance(ev, dict) and "ledger" in ev: | 70 | if isinstance(ev, dict) and "ledger" in ev: | ||
| 71 | L = ev["ledger"]; out["retention_rate"] = L["retention_rate"]; out["unsupported"] = L["unsupported_numbers"] + L["unsupported_identifiers"]; out["distorted"] = L["distorted_sentences"]; out["msg_bytes_hop"] = L["message_bytes"] | 71 | L = ev["ledger"]; out["retention_rate"] = L["retention_rate"]; out["unsupported"] = L["unsupported_numbers"] + L["unsupported_identifiers"]; out["distorted"] = L["distorted_sentences"]; out["msg_bytes_hop"] = L["message_bytes"] | ||
| 72 | out.update(_scenario_costs(r)) | 72 | out.update(_scenario_costs(r)) | ||
| 73 | + pp, pdm = r.get("peak_prefill_memory"), r.get("peak_decode_memory") | ||||
| 74 | + out["peak_memory_cold"] = max([x for x in (pp, pdm) if x is not None], default=None) # cache methods: include the document-build peak | ||||
| 73 | sp = r.get("timing_spans") or {} | 75 | sp = r.get("timing_spans") or {} | ||
| 74 | for k in ["encode_ms", "doc_prefill_ms", "compress_ms", "serialize_ms", "load_ms", "receiver_prefill_ms", "query_prefill_ms", "decode_ms", "sender_prefill_ms"]: | 76 | for k in ["encode_ms", "doc_prefill_ms", "compress_ms", "serialize_ms", "load_ms", "receiver_prefill_ms", "query_prefill_ms", "decode_ms", "sender_prefill_ms"]: | ||
| 75 | out["span_" + k] = sp.get(k) | 77 | out["span_" + k] = sp.get(k) | ||
| 76 | 78 | ||||